Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 855154 Details for
Bug 1057764
Export Template with Force Override activate fails
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/x-log), 1.35 MB, created by
Carlos Mestre González
on 2014-01-24 18:48:14 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Carlos Mestre González
Created:
2014-01-24 18:48:14 UTC
Size:
1.35 MB
patch
obsolete
>Thread-491::DEBUG::2014-01-24 19:08:28,324::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:29,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:29,595::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::DEBUG::2014-01-24 19:08:31,001::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::DEBUG::2014-01-24 19:08:31,002::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1'] >Thread-485::DEBUG::2014-01-24 19:08:31,002::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-491::DEBUG::2014-01-24 19:08:31,079::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-491::DEBUG::2014-01-24 19:08:31,084::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 2a36092f-90ff-444a-b58c-df8cd0759196 changed its status to Valid >Thread-493::DEBUG::2014-01-24 19:08:31,085::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-493::DEBUG::2014-01-24 19:08:31,085::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-493::DEBUG::2014-01-24 19:08:31,086::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-494::INFO::2014-01-24 19:08:31,090::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-12::DEBUG::2014-01-24 19:08:31,602::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:31,606::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:08:33,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:33,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-496::INFO::2014-01-24 19:08:35,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-496::INFO::2014-01-24 19:08:35,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00052633', 'lastCheck': '4.4', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:08:35,616::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:35,621::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::DEBUG::2014-01-24 19:08:37,598::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::WARNING::2014-01-24 19:08:37,600::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/images already exists >Thread-485::WARNING::2014-01-24 19:08:37,601::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/dom_md already exists >Thread-485::INFO::2014-01-24 19:08:37,601::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196 to /rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/2a36092f-90ff-444a-b58c-df8cd0759196 >Thread-485::INFO::2014-01-24 19:08:37,602::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196 to /rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd >Thread-485::DEBUG::2014-01-24 19:08:37,603::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-485::DEBUG::2014-01-24 19:08:37,610::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00248133 s, 1.7 MB/s\n'; <rc> = 0 >Thread-485::INFO::2014-01-24 19:08:37,610::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-485::DEBUG::2014-01-24 19:08:37,611::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:37,624::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:37,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-485::DEBUG::2014-01-24 19:08:38,616::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00137 s, 4.1 kB/s\n'; <rc> = 0 >Thread-485::DEBUG::2014-01-24 19:08:38,616::storage_mailbox::209::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool c08b415a-44b7-4885-adad-a16c66e15971 >Thread-485::DEBUG::2014-01-24 19:08:38,617::sp::491::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool c08b415a-44b7-4885-adad-a16c66e15971 on master domain 2a36092f-90ff-444a-b58c-df8cd0759196 >Thread-485::INFO::2014-01-24 19:08:38,618::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-505::DEBUG::2014-01-24 19:08:38,756::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-505::INFO::2014-01-24 19:08:38,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', options=None) >Thread-505::INFO::2014-01-24 19:08:38,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-506::DEBUG::2014-01-24 19:08:38,809::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-506::INFO::2014-01-24 19:08:38,809::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', prevID=-1, prevLVER='0', maxHostID=250, domVersion='3', options=None) >Thread-506::INFO::2014-01-24 19:08:38,810::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:38,811::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:39,632::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:39,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-507::DEBUG::2014-01-24 19:08:39,821::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-507::INFO::2014-01-24 19:08:39,822::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-507::INFO::2014-01-24 19:08:39,822::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-508::DEBUG::2014-01-24 19:08:40,828::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-508::INFO::2014-01-24 19:08:40,828::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-508::INFO::2014-01-24 19:08:40,828::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-491::DEBUG::2014-01-24 19:08:41,087::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:41,351::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:41,352::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1'] >Thread-12::DEBUG::2014-01-24 19:08:41,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:41,644::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-510::DEBUG::2014-01-24 19:08:41,834::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-510::INFO::2014-01-24 19:08:41,835::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-510::INFO::2014-01-24 19:08:41,835::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-511::DEBUG::2014-01-24 19:08:42,841::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-511::INFO::2014-01-24 19:08:42,842::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-511::INFO::2014-01-24 19:08:42,842::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-491::DEBUG::2014-01-24 19:08:43,419::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-491::DEBUG::2014-01-24 19:08:43,422::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata bs=4096 count=1' (cwd None) >Thread-491::DEBUG::2014-01-24 19:08:43,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653204 s, 6.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:08:43,647::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:43,651::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-512::DEBUG::2014-01-24 19:08:43,848::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-512::INFO::2014-01-24 19:08:43,849::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-512::INFO::2014-01-24 19:08:43,849::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-514::DEBUG::2014-01-24 19:08:44,855::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-514::INFO::2014-01-24 19:08:44,855::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-514::INFO::2014-01-24 19:08:44,855::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:45,654::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:45,658::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-515::DEBUG::2014-01-24 19:08:45,863::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-515::INFO::2014-01-24 19:08:45,863::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-515::INFO::2014-01-24 19:08:45,864::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-516::DEBUG::2014-01-24 19:08:46,870::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-516::INFO::2014-01-24 19:08:46,870::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-516::INFO::2014-01-24 19:08:46,870::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:47,661::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:47,665::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-518::DEBUG::2014-01-24 19:08:47,877::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-518::INFO::2014-01-24 19:08:47,877::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-518::INFO::2014-01-24 19:08:47,877::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-519::DEBUG::2014-01-24 19:08:48,892::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-519::INFO::2014-01-24 19:08:48,893::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-519::INFO::2014-01-24 19:08:48,894::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:49,669::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:49,673::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-520::DEBUG::2014-01-24 19:08:49,900::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-520::INFO::2014-01-24 19:08:49,900::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-520::INFO::2014-01-24 19:08:49,900::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-521::INFO::2014-01-24 19:08:50,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-521::INFO::2014-01-24 19:08:50,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00052633', 'lastCheck': '19.7', 'valid': True}} >Thread-523::DEBUG::2014-01-24 19:08:50,906::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-523::INFO::2014-01-24 19:08:50,906::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-523::INFO::2014-01-24 19:08:50,906::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:51,676::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:51,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-524::DEBUG::2014-01-24 19:08:51,933::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-524::INFO::2014-01-24 19:08:51,934::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-524::INFO::2014-01-24 19:08:51,934::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:08:52,354::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/images already exists >03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:08:52,354::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/dom_md already exists >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,355::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,357::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602569 s, 3.4 MB/s\n'; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602569 s, 3.4 MB/s'], size: 2048 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,362::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,362::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-525::DEBUG::2014-01-24 19:08:52,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-525::INFO::2014-01-24 19:08:52,941::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-525::INFO::2014-01-24 19:08:52,941::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:53,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:53,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-527::DEBUG::2014-01-24 19:08:53,982::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-527::INFO::2014-01-24 19:08:53,984::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-527::INFO::2014-01-24 19:08:53,984::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,844::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,845::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,904::sp::298::Storage.StoragePool::(startSpm) spm lock acquired successfully >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,905::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-528::DEBUG::2014-01-24 19:08:54,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-528::INFO::2014-01-24 19:08:54,991::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-528::INFO::2014-01-24 19:08:54,991::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:08:55,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:55,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-529::DEBUG::2014-01-24 19:08:55,997::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-529::INFO::2014-01-24 19:08:55,998::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-529::INFO::2014-01-24 19:08:55,998::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-531::DEBUG::2014-01-24 19:08:57,003::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-531::INFO::2014-01-24 19:08:57,004::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-531::INFO::2014-01-24 19:08:57,004::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,427::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,429::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:57,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:57,701::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-532::DEBUG::2014-01-24 19:08:58,010::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-532::INFO::2014-01-24 19:08:58,010::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-532::INFO::2014-01-24 19:08:58,010::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-533::DEBUG::2014-01-24 19:08:59,017::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-533::INFO::2014-01-24 19:08:59,018::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-533::INFO::2014-01-24 19:08:59,019::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,682::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,683::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=0 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3 --addtag MDT_POOL_SPM_LVER=1 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:59,704::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:08:59,710::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,847::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,847::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:08:59,848::sp::462::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `2a36092f-90ff-444a-b58c-df8cd0759196` >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,849::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-535::DEBUG::2014-01-24 19:09:00,027::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-535::INFO::2014-01-24 19:09:00,028::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-535::INFO::2014-01-24 19:09:00,028::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-536::DEBUG::2014-01-24 19:09:01,044::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-536::INFO::2014-01-24 19:09:01,044::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-536::INFO::2014-01-24 19:09:01,044::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:09:01,715::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:01,719::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-537::DEBUG::2014-01-24 19:09:02,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-537::INFO::2014-01-24 19:09:02,051::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-537::INFO::2014-01-24 19:09:02,051::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,060::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,061::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,062::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000531815 s, 3.9 MB/s\n'; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000531815 s, 3.9 MB/s'], size: 2048 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,068::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,068::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-539::DEBUG::2014-01-24 19:09:03,057::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-539::INFO::2014-01-24 19:09:03,057::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-539::INFO::2014-01-24 19:09:03,058::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:09:03,722::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:03,726::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-540::DEBUG::2014-01-24 19:09:04,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-540::INFO::2014-01-24 19:09:04,064::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-540::INFO::2014-01-24 19:09:04,064::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,271::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,272::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_imageNS already registered >03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_volumeNS already registered >03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_lvmActivationNS already registered >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,274::sp::467::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >Thread-491::DEBUG::2014-01-24 19:09:04,275::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,281::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-491::DEBUG::2014-01-24 19:09:04,369::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-491::DEBUG::2014-01-24 19:09:04,371::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata bs=4096 count=1' (cwd None) >Thread-491::DEBUG::2014-01-24 19:09:04,376::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602092 s, 6.8 MB/s\n'; <rc> = 0 >Thread-491::DEBUG::2014-01-24 19:09:04,377::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-541::DEBUG::2014-01-24 19:09:05,070::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-541::INFO::2014-01-24 19:09:05,071::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-541::INFO::2014-01-24 19:09:05,071::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:09:05,729::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:05,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-542::INFO::2014-01-24 19:09:05,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-542::INFO::2014-01-24 19:09:05,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653204', 'lastCheck': '13.5', 'valid': True}} >Thread-544::DEBUG::2014-01-24 19:09:06,077::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-544::INFO::2014-01-24 19:09:06,077::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-544::INFO::2014-01-24 19:09:06,078::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,548::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::sp::474::Storage.StoragePool::(_upgradePool) Registering with state change event >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::sp::477::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:09:06,550::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master already exists >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,550::blockSD::1137::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,590::blockSD::1137::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,590::blockSD::1162::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,599::blockSD::1162::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,600::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,621::blockSD::1174::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,635::blockSD::1174::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,635::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master/vms >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,636::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master/tasks >Thread-491::DEBUG::2014-01-24 19:09:06,640::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,642::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-545::DEBUG::2014-01-24 19:09:07,085::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-545::INFO::2014-01-24 19:09:07,089::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-545::INFO::2014-01-24 19:09:07,089::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-12::DEBUG::2014-01-24 19:09:07,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:07,741::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-546::DEBUG::2014-01-24 19:09:08,096::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-546::INFO::2014-01-24 19:09:08,096::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-546::INFO::2014-01-24 19:09:08,096::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,940::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,941::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,949::storage_mailbox::576::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,951::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,993::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360325 s, 28.4 MB/s\n'; <rc> = 0 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,993::storage_mailbox::584::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool c08b415a-44b7-4885-adad-a16c66e15971 >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,994::sp::349::Storage.StoragePool::(startSpm) SPM mailbox ready for pool c08b415a-44b7-4885-adad-a16c66e15971 on master domain 2a36092f-90ff-444a-b58c-df8cd0759196 >Dummy-552::DEBUG::2014-01-24 19:09:08,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,995::sp::357::Storage.StoragePool::(startSpm) ended. >Dummy-552::DEBUG::2014-01-24 19:09:09,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276255 s, 37.1 MB/s\n'; <rc> = 0 >Thread-554::DEBUG::2014-01-24 19:09:09,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-554::INFO::2014-01-24 19:09:09,133::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-554::INFO::2014-01-24 19:09:09,133::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}} >Thread-555::DEBUG::2014-01-24 19:09:09,200::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-555::INFO::2014-01-24 19:09:09,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', options=None) >Thread-555::INFO::2014-01-24 19:09:09,201::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-556::DEBUG::2014-01-24 19:09:09,242::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-556::INFO::2014-01-24 19:09:09,243::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None) >Thread-556::INFO::2014-01-24 19:09:09,243::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-557::DEBUG::2014-01-24 19:09:09,322::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-557::INFO::2014-01-24 19:09:09,322::logUtils::44::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', hostID=1, options=None) >Thread-557::INFO::2014-01-24 19:09:09,322::hsm::1122::Storage.HSM::(destroyStoragePool) spUUID=c08b415a-44b7-4885-adad-a16c66e15971 >Thread-557::WARNING::2014-01-24 19:09:09,323::sp::972::Storage.StoragePool::(forcedDetachSD) Force detaching domain `2a36092f-90ff-444a-b58c-df8cd0759196` >Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f'] >Thread-557::DEBUG::2014-01-24 19:09:09,325::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:09,744::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:09,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-552::DEBUG::2014-01-24 19:09:11,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-552::DEBUG::2014-01-24 19:09:11,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269429 s, 38.0 MB/s\n'; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:11,560::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:11,561::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3 --deltag MDT_POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active --addtag MDT_POOL_DOMAINS= --addtag MDT__SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-557::DEBUG::2014-01-24 19:09:11,741::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:11,741::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-557::DEBUG::2014-01-24 19:09:11,742::sp::367::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-557::DEBUG::2014-01-24 19:09:11,745::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping >Thread-557::DEBUG::2014-01-24 19:09:11,747::sp::405::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master >Thread-12::DEBUG::2014-01-24 19:09:11,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:11,766::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:12,118::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >Thread-557::DEBUG::2014-01-24 19:09:12,215::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping >Thread-557::DEBUG::2014-01-24 19:09:12,216::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping >Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7'] >Thread-557::DEBUG::2014-01-24 19:09:12,218::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:13,784::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:13,789::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-552::INFO::2014-01-24 19:09:14,950::storage_mailbox::796::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-557::DEBUG::2014-01-24 19:09:15,501::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:15,502::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f --addtag MDT__SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7 --addtag MDT_POOL_SPM_ID=-1 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-557::DEBUG::2014-01-24 19:09:15,675::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:15,675::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-557::DEBUG::2014-01-24 19:09:15,725::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:15,792::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:15,797::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:17,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:17,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:17,949::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:17,950::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7', 'POOL_SPM_ID=-1'] >Thread-557::INFO::2014-01-24 19:09:17,951::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 2a36092f-90ff-444a-b58c-df8cd0759196 >Thread-491::DEBUG::2014-01-24 19:09:17,951::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 2a36092f-90ff-444a-b58c-df8cd0759196 >Thread-12::DEBUG::2014-01-24 19:09:19,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:19,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:19,952::sp::1495::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `c08b415a-44b7-4885-adad-a16c66e15971` stopped monitoring domain `2a36092f-90ff-444a-b58c-df8cd0759196` >Thread-557::DEBUG::2014-01-24 19:09:19,952::sp::989::Storage.StoragePool::(forcedDetachSD) Force detach for domain `2a36092f-90ff-444a-b58c-df8cd0759196` is done >Thread-557::DEBUG::2014-01-24 19:09:19,953::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-561::INFO::2014-01-24 19:09:21,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-561::INFO::2014-01-24 19:09:21,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:09:21,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:21,821::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:23,824::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:23,828::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:24,287::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:24,288::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7', 'POOL_SPM_ID=-1'] >Thread-557::DEBUG::2014-01-24 19:09:24,288::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314'] >Thread-557::DEBUG::2014-01-24 19:09:24,290::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:25,831::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:25,836::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:26,530::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:26,532::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_ROLE=Master --deltag MDT__SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7 --deltag MDT_POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971 --addtag MDT__SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314 --addtag MDT_ROLE=Regular --addtag MDT_POOL_UUID= 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-557::DEBUG::2014-01-24 19:09:26,693::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:26,693::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-557::INFO::2014-01-24 19:09:26,694::sp::698::Storage.StoragePool::(disconnect) Disconnect from the storage pool c08b415a-44b7-4885-adad-a16c66e15971 >Thread-12::DEBUG::2014-01-24 19:09:27,839::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:27,843::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:28,608::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-503::INFO::2014-01-24 19:09:28,622::storage_mailbox::511::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-503::INFO::2014-01-24 19:09:28,622::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-503::DEBUG::2014-01-24 19:09:28,622::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:29,846::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:29,851::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:31,129::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-557::DEBUG::2014-01-24 19:09:31,131::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID='] >Thread-557::INFO::2014-01-24 19:09:31,132::logUtils::47::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True >Thread-566::DEBUG::2014-01-24 19:09:31,181::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-566::INFO::2014-01-24 19:09:31,182::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='c08b415a-44b7-4885-adad-a16c66e15971', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None) >Thread-566::DEBUG::2014-01-24 19:09:31,189::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 6 -u' (cwd None) >Thread-566::DEBUG::2014-01-24 19:09:31,764::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-566::DEBUG::2014-01-24 19:09:31,764::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-566::DEBUG::2014-01-24 19:09:31,765::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:31,854::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:31,859::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:33,861::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:33,866::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:35,869::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:35,873::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-566::DEBUG::2014-01-24 19:09:36,022::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-568::INFO::2014-01-24 19:09:36,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-568::INFO::2014-01-24 19:09:36,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:09:37,876::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:37,880::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-566::DEBUG::2014-01-24 19:09:39,409::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-566::INFO::2014-01-24 19:09:39,410::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]} >Thread-571::DEBUG::2014-01-24 19:09:39,421::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9] >Thread-571::INFO::2014-01-24 19:09:39,422::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', hostID=1, remove=False, options=None) >Thread-571::WARNING::2014-01-24 19:09:39,422::hsm::1088::Storage.HSM::(disconnectStoragePool) disconnect sp: c08b415a-44b7-4885-adad-a16c66e15971 failed. Known pools {} >Thread-571::INFO::2014-01-24 19:09:39,422::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None >Thread-12::DEBUG::2014-01-24 19:09:39,883::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:39,888::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:41,529::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [392b1956] >Thread-572::INFO::2014-01-24 19:09:41,529::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None) >Thread-572::DEBUG::2014-01-24 19:09:41,529::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-572::DEBUG::2014-01-24 19:09:41,540::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:41,541::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:41,891::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:41,895::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:42,109::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:42,110::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-572::DEBUG::2014-01-24 19:09:42,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:42,125::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:43,898::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:43,903::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:45,908::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:45,912::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:47,915::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:47,919::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:48,564::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-572::DEBUG::2014-01-24 19:09:48,566::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '2a36092f-90ff-444a-b58c-df8cd0759196') >Thread-572::DEBUG::2014-01-24 19:09:48,566::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 2a36092f-90ff-444a-b58c-df8cd0759196: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-572::INFO::2014-01-24 19:09:48,566::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]} >Thread-576::DEBUG::2014-01-24 19:09:48,578::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c] >Thread-576::INFO::2014-01-24 19:09:48,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', options=None) >Thread-576::DEBUG::2014-01-24 19:09:48,609::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:49,922::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:49,927::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-576::DEBUG::2014-01-24 19:09:50,922::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-576::INFO::2014-01-24 19:09:50,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': '2a36092f-90ff-444a-b58c-df8cd0759196', 'vgfree': '86704652288', 'vgUUID': 'BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': 'BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-577::DEBUG::2014-01-24 19:09:50,976::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c] >Thread-577::INFO::2014-01-24 19:09:50,976::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='2a36092f-90ff-444a-b58c-df8cd0759196', autoDetach=False, options=None) >Thread-577::DEBUG::2014-01-24 19:09:50,976::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-577::DEBUG::2014-01-24 19:09:50,977::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-578::INFO::2014-01-24 19:09:51,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-578::INFO::2014-01-24 19:09:51,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:09:51,931::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:51,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:09:53,299::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:53,938::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:53,943::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:09:55,862::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:09:55,863::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-577::DEBUG::2014-01-24 19:09:55,863::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:55,946::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:55,951::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:09:57,957::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:57,961::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:09:58,355::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:59,964::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:09:59,970::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:01,050::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:01,053::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:01,975::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:01,986::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:03,313::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:03,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-577::DEBUG::2014-01-24 19:10:03,317::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None) >Thread-577::DEBUG::2014-01-24 19:10:03,322::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000616359 s, 3.3 MB/s\n'; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:03,322::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000616359 s, 3.3 MB/s'], size: 2048 >Thread-577::DEBUG::2014-01-24 19:10:03,322::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-577::DEBUG::2014-01-24 19:10:03,322::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-577::DEBUG::2014-01-24 19:10:03,323::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:03,992::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:03,996::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:05,605::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:05,606::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID='] >Thread-577::INFO::2014-01-24 19:10:05,606::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_imageNS already registered >Thread-577::INFO::2014-01-24 19:10:05,606::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_volumeNS already registered >Thread-577::INFO::2014-01-24 19:10:05,606::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_lvmActivationNS already registered >Thread-577::DEBUG::2014-01-24 19:10:05,607::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:05,999::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:06,004::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-584::INFO::2014-01-24 19:10:06,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-584::INFO::2014-01-24 19:10:06,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-577::DEBUG::2014-01-24 19:10:07,807::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:07,808::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID='] >Thread-577::DEBUG::2014-01-24 19:10:07,808::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-577::DEBUG::2014-01-24 19:10:07,902::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:07,905::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-577::WARNING::2014-01-24 19:10:07,905::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/master >Thread-577::DEBUG::2014-01-24 19:10:07,906::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:08,007::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:08,014::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:08,023::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::WARNING::2014-01-24 19:10:08,023::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/leases >Thread-577::DEBUG::2014-01-24 19:10:08,024::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/leases' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:10,018::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:10,026::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:10,379::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::WARNING::2014-01-24 19:10:10,380::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/inbox >Thread-577::DEBUG::2014-01-24 19:10:10,380::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/inbox' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:12,033::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:12,037::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:12,590::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::WARNING::2014-01-24 19:10:12,590::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/outbox >Thread-577::DEBUG::2014-01-24 19:10:12,590::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/outbox' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:14,040::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:14,045::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:15,074::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::WARNING::2014-01-24 19:10:15,074::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/ids >Thread-577::DEBUG::2014-01-24 19:10:15,074::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/ids' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:16,051::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:16,055::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:17,340::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::WARNING::2014-01-24 19:10:17,340::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/metadata >Thread-577::DEBUG::2014-01-24 19:10:17,341::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/metadata' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:18,058::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:18,062::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:20,065::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:20,070::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:20,445::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:20,446::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " -f 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None) >Thread-590::INFO::2014-01-24 19:10:21,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-590::INFO::2014-01-24 19:10:21,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:10:22,072::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:22,077::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::DEBUG::2014-01-24 19:10:22,752::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-577::INFO::2014-01-24 19:10:22,753::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None >Thread-592::DEBUG::2014-01-24 19:10:22,768::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c] >Thread-592::INFO::2014-01-24 19:10:22,768::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None) >Thread-592::DEBUG::2014-01-24 19:10:22,775::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 7 -u' (cwd None) >Thread-592::DEBUG::2014-01-24 19:10:23,345::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-592::DEBUG::2014-01-24 19:10:23,345::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-592::DEBUG::2014-01-24 19:10:23,346::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:24,080::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:24,085::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:26,089::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:26,094::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-592::DEBUG::2014-01-24 19:10:27,580::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:28,097::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:28,101::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:30,104::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:30,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-592::DEBUG::2014-01-24 19:10:30,784::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-592::INFO::2014-01-24 19:10:30,785::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]} >Thread-12::DEBUG::2014-01-24 19:10:32,117::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:32,122::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-596::INFO::2014-01-24 19:10:33,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-596::INFO::2014-01-24 19:10:33,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:10:34,125::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:34,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:36,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:36,136::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:38,139::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:38,143::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:40,146::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:40,151::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:42,154::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:42,158::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:44,161::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:44,166::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:46,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:46,173::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:48,176::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:48,180::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:50,183::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:50,187::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:52,190::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:52,194::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:54,197::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:54,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:56,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:56,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:10:58,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:10:58,215::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:00,218::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:00,222::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:02,225::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:02,229::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:04,232::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:04,237::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:06,240::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:06,244::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:08,247::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:08,251::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:10,254::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:10,258::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:12,261::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:12,265::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:14,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:14,272::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:16,275::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:16,279::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:18,282::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:18,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:20,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:20,293::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:22,296::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:22,300::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:24,303::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:24,307::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:26,310::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:26,314::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:28,317::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:28,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:30,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:30,328::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:32,331::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:32,335::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:34,338::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:34,342::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:36,345::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:36,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:38,352::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:38,356::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:40,359::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:40,363::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:42,366::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:42,370::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:44,373::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:44,377::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:46,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:46,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:48,386::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:48,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:50,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:50,398::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:52,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:52,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:54,407::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:54,412::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:56,414::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:56,419::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:11:58,421::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:11:58,426::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:00,428::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:00,433::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:02,435::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:02,440::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:04,442::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:04,447::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:06,450::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:06,454::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:08,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:08,461::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:10,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:10,468::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:12,470::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:12,474::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:14,477::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:14,481::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:16,484::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:16,488::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:18,491::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:18,495::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:20,498::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:20,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:22,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:22,509::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:24,512::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:24,516::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:26,519::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:26,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:28,526::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:28,530::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:30,533::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:30,537::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:32,540::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:32,544::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:34,547::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:34,551::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:36,554::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:36,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:38,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:38,565::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:40,568::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:40,572::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:42,575::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:42,579::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:44,582::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:44,586::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:46,589::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:46,595::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:48,598::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:48,602::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:50,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:50,609::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:52,612::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:52,616::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:54,619::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:54,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:56,626::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:56,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:12:58,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:12:58,638::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:00,641::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:00,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:02,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:02,652::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:04,655::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:04,659::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:06,662::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:06,666::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:08,669::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:08,673::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:10,676::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:10,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:12,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:12,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:14,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:14,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:16,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:16,701::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:18,704::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:18,708::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:20,711::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:20,715::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:22,718::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:22,722::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:24,725::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:24,729::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:26,732::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:26,736::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:28,739::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:28,743::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:30,746::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:30,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:32,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:32,757::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:34,760::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:34,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:36,767::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:36,771::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:38,774::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:38,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:40,781::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:40,785::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:42,788::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:42,792::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:44,795::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:44,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:46,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:46,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:48,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:48,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:50,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:50,821::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:52,823::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:52,828::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:54,830::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:54,835::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:56,838::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:56,842::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:13:58,844::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:13:58,849::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:00,852::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:00,856::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:02,858::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:02,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:04,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:04,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:06,872::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:06,876::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:08,879::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:08,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:10,886::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:10,890::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:12,893::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:12,897::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:14,900::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:14,904::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:16,907::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:16,911::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:18,914::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:18,918::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:20,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:20,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:22,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:22,932::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:24,935::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:24,939::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:26,942::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:26,946::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:28,949::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:28,953::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:30,956::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:30,960::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:32,963::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:32,967::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:34,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:34,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:36,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:36,981::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:38,984::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:38,988::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:40,991::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:40,995::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:42,998::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:43,002::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:45,005::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:45,009::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:47,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:47,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:49,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:49,023::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:51,026::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:51,030::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:53,033::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:53,037::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:55,040::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:55,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:57,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:57,051::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:14:59,054::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:14:59,058::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:01,061::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:01,065::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:03,068::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:03,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:05,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:05,079::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:07,082::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:07,086::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:09,089::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:09,093::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:11,096::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:11,100::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:13,103::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:13,107::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:15,110::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:15,114::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:17,117::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:17,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:19,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:19,128::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:21,131::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:21,135::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:23,138::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:23,142::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:25,145::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:25,149::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:27,152::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:27,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:29,159::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:29,164::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:31,166::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:31,170::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:33,173::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:33,177::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:35,180::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:35,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:37,187::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:37,191::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:39,194::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:39,198::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:41,201::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:41,205::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:43,208::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:43,212::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:45,215::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:45,219::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:47,222::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:47,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:49,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:49,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:51,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:51,240::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:53,243::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:53,247::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:55,250::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:55,254::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:57,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:57,261::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:15:59,264::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:15:59,268::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:01,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:01,275::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:03,278::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:03,282::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:05,285::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:05,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:07,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:07,296::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:09,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:09,303::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:11,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:11,310::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:13,313::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:13,317::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:15,320::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:15,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:17,327::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:17,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:19,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:19,339::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:21,342::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:21,346::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:23,349::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:23,353::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:25,356::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:25,360::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:27,363::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:27,367::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:29,370::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:29,374::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:31,377::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:31,381::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:33,384::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:33,388::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:35,391::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:35,395::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:37,398::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:37,402::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:39,405::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:39,409::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:41,412::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:41,416::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:43,418::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:43,422::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:45,425::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:45,430::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:47,432::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:47,437::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:49,439::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:49,444::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:51,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:51,450::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:53,453::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:53,457::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:55,460::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:55,464::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:57,467::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:57,471::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:16:59,474::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:16:59,478::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:01,481::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:01,485::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:03,488::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:03,492::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:05,495::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:05,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:07,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:07,506::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:09,509::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:09,514::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:11,516::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:11,520::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:13,523::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:13,527::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:15,530::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:15,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:17,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:17,541::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:19,544::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:19,548::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:21,551::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:21,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:23,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:23,562::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:25,565::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:25,569::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:27,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:27,576::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:29,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:29,583::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:31,586::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:31,590::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:33,593::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:33,597::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:35,600::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:35,604::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:37,607::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:37,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:39,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:39,618::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:41,621::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:41,625::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:43,628::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:43,632::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:45,635::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:45,639::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:47,642::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:47,646::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:49,649::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:49,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:51,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:51,660::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:53,663::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:53,667::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:55,670::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:55,674::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:57,677::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:57,681::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:17:59,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:17:59,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:01,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:01,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:03,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:03,702::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:05,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:05,709::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:07,712::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:07,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:09,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:09,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:11,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:11,730::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:13,733::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:13,749::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:15,758::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:15,763::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:17,769::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:17,773::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:19,776::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:19,780::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:21,783::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:21,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:23,790::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:23,794::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:25,797::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:25,812::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:27,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:27,837::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:29,846::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:29,858::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:31,867::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:31,875::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:33,878::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:33,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:18:35,887::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:35,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-01-24 19:18:36,590::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-01-24 19:18:37,453::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-01-24 19:18:37,453::momIF::84::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-01-24 19:18:37,454::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >MainThread::DEBUG::2014-01-24 19:18:37,457::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:37,458::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:37,459::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:37,460::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping >VM Channels Listener::INFO::2014-01-24 19:18:37,492::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-01-24 19:18:37,803::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::INFO::2014-01-24 19:18:37,803::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::INFO::2014-01-24 19:18:37,803::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 15 other threads... >MainThread::INFO::2014-01-24 19:18:37,803::vdsm::129::vds::(run) <_MainThread(MainThread, started 139732044535552)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 139731910616832)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 139731879147264)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 139731900126976)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 139731660699392)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 139731608250112)> >MainThread::INFO::2014-01-24 19:18:37,804::momIF::84::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <MomThread(MOM, started 139731148977920)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 139731629229824)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 139731639719680)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 139731190937344)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 139731618739968)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <HostMonitor(HostMonitor, started daemon 139731138488064)> >MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 139730679080704)> >MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <WorkerThread(612b8a1c-fc4a-4b9e-9528-f079dab1b54f, started daemon 139731650209536)> >MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 139730689570560)> >MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <WorkerThread(03525778-e2ca-4a94-bcb5-34b424d1b6d2, started daemon 139731889637120)> >MainThread::INFO::2014-01-24 19:18:45,677::vdsm::119::vds::(run) (PID: 14246) I am the actual vdsm 4.14.0-21.git54cc674.el6 dell-r210ii-14.rhev.lab.eng.brq.redhat.com (2.6.32-431.el6.x86_64) >MainThread::WARNING::2014-01-24 19:18:45,680::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-01-24 19:18:45,683::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:45,685::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:45,686::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:45,688::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping >MainThread::DEBUG::2014-01-24 19:18:46,119::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-01-24 19:18:46,119::hsm::420::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-01-24 19:18:46,220::hsm::420::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-01-24 19:18:46,220::hsm::444::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::476::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::477::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::479::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-01-24 19:18:46,223::hsm::522::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >MainThread::INFO::2014-01-24 19:18:46,224::dispatcher::99::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-01-24 19:18:46,224::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-01-24 19:18:46,241::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >MainThread::INFO::2014-01-24 19:18:46,257::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1992290>>) >MainThread::INFO::2014-01-24 19:18:46,257::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-01-24 19:18:46,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >MainThread::DEBUG::2014-01-24 19:18:46,262::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >MainThread::INFO::2014-01-24 19:18:46,266::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-01-24 19:18:46,268::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-01-24 19:18:46,270::vmChannels::170::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-01-24 19:18:46,277::libvirtconnection::145::root::(get) trying to connect libvirt >MainThread::WARNING::2014-01-24 19:18:46,283::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >Thread-13::DEBUG::2014-01-24 19:18:46,612::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-13::DEBUG::2014-01-24 19:18:46,612::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-14::DEBUG::2014-01-24 19:18:47,249::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-14::DEBUG::2014-01-24 19:18:47,249::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-15::DEBUG::2014-01-24 19:18:47,808::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-15::DEBUG::2014-01-24 19:18:47,808::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:48,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:48,273::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-01-24 19:18:48,318::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-16::DEBUG::2014-01-24 19:18:48,330::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-16::DEBUG::2014-01-24 19:18:48,330::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-17::DEBUG::2014-01-24 19:18:48,877::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-17::DEBUG::2014-01-24 19:18:48,877::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-18::DEBUG::2014-01-24 19:18:49,421::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-18::DEBUG::2014-01-24 19:18:49,421::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-19::DEBUG::2014-01-24 19:18:49,942::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-19::DEBUG::2014-01-24 19:18:49,945::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:50,276::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:50,281::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-01-24 19:18:50,464::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-20::DEBUG::2014-01-24 19:18:50,464::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-21::DEBUG::2014-01-24 19:18:50,996::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-21::DEBUG::2014-01-24 19:18:50,996::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-22::DEBUG::2014-01-24 19:18:51,531::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-22::DEBUG::2014-01-24 19:18:51,533::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-01-24 19:18:51,788::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-01-24 19:18:51,791::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-23::DEBUG::2014-01-24 19:18:52,070::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-23::DEBUG::2014-01-24 19:18:52,070::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:52,284::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:52,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2014-01-24 19:18:52,593::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-24::DEBUG::2014-01-24 19:18:52,593::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-25::DEBUG::2014-01-24 19:18:53,108::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-25::DEBUG::2014-01-24 19:18:53,108::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-26::DEBUG::2014-01-24 19:18:53,623::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-26::DEBUG::2014-01-24 19:18:53,623::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-27::DEBUG::2014-01-24 19:18:54,148::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-27::DEBUG::2014-01-24 19:18:54,148::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:54,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:54,296::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-01-24 19:18:54,680::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-28::DEBUG::2014-01-24 19:18:54,680::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-29::DEBUG::2014-01-24 19:18:55,193::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-29::DEBUG::2014-01-24 19:18:55,193::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-30::DEBUG::2014-01-24 19:18:55,712::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-30::DEBUG::2014-01-24 19:18:55,712::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-31::DEBUG::2014-01-24 19:18:56,235::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-31::DEBUG::2014-01-24 19:18:56,235::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:56,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:56,303::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-01-24 19:18:56,576::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-01-24 19:18:56,577::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-32::DEBUG::2014-01-24 19:18:56,758::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-32::DEBUG::2014-01-24 19:18:56,758::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-33::DEBUG::2014-01-24 19:18:57,273::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-33::DEBUG::2014-01-24 19:18:57,273::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-34::DEBUG::2014-01-24 19:18:57,810::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-34::DEBUG::2014-01-24 19:18:57,810::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:18:58,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:18:58,310::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2014-01-24 19:18:58,330::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-35::DEBUG::2014-01-24 19:18:58,330::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-36::DEBUG::2014-01-24 19:18:58,883::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-36::DEBUG::2014-01-24 19:18:58,883::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-37::DEBUG::2014-01-24 19:18:59,437::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-37::DEBUG::2014-01-24 19:18:59,437::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-38::DEBUG::2014-01-24 19:18:59,976::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-38::DEBUG::2014-01-24 19:18:59,976::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:19:00,313::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:00,317::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-39::DEBUG::2014-01-24 19:19:00,493::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-39::DEBUG::2014-01-24 19:19:00,493::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-40::DEBUG::2014-01-24 19:19:01,011::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-40::DEBUG::2014-01-24 19:19:01,011::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-41::DEBUG::2014-01-24 19:19:01,533::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-41::DEBUG::2014-01-24 19:19:01,534::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-42::DEBUG::2014-01-24 19:19:02,050::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-42::DEBUG::2014-01-24 19:19:02,053::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:19:02,320::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:02,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-43::DEBUG::2014-01-24 19:19:02,574::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-43::DEBUG::2014-01-24 19:19:02,574::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-44::DEBUG::2014-01-24 19:19:03,097::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-44::DEBUG::2014-01-24 19:19:03,097::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-45::DEBUG::2014-01-24 19:19:03,617::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-45::DEBUG::2014-01-24 19:19:03,617::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-46::DEBUG::2014-01-24 19:19:04,128::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-46::DEBUG::2014-01-24 19:19:04,129::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:19:04,326::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:04,330::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-47::DEBUG::2014-01-24 19:19:04,642::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-47::DEBUG::2014-01-24 19:19:04,642::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-01-24 19:19:05,078::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-01-24 19:19:05,079::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-48::DEBUG::2014-01-24 19:19:05,167::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-48::DEBUG::2014-01-24 19:19:05,167::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-49::DEBUG::2014-01-24 19:19:05,682::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-49::DEBUG::2014-01-24 19:19:05,682::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-50::DEBUG::2014-01-24 19:19:06,200::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-50::DEBUG::2014-01-24 19:19:06,200::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:19:06,333::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:06,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-51::DEBUG::2014-01-24 19:19:06,715::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-51::DEBUG::2014-01-24 19:19:06,715::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-52::DEBUG::2014-01-24 19:19:07,236::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999] >Thread-52::DEBUG::2014-01-24 19:19:07,236::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Thread-12::DEBUG::2014-01-24 19:19:08,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:08,344::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:10,347::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:10,351::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-53::DEBUG::2014-01-24 19:19:10,402::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {} >Thread-53::DEBUG::2014-01-24 19:19:10,402::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-01-24 19:19:10,454::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::WARNING::2014-01-24 19:19:10,460::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-01-24 19:19:10,461::hsm::388::Storage.HSM::(storageRefresh) HSM is ready >Thread-12::DEBUG::2014-01-24 19:19:12,354::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:12,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-54::DEBUG::2014-01-24 19:19:13,579::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {} >Thread-54::DEBUG::2014-01-24 19:19:13,619::utils::555::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-54::DEBUG::2014-01-24 19:19:13,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-54::DEBUG::2014-01-24 19:19:13,627::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-54::DEBUG::2014-01-24 19:19:13,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-54::DEBUG::2014-01-24 19:19:13,652::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:647f414138d4'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384118394.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '21.git54cc674.el6', 'buildtime': 1389728033L, 'version': '4.14.0'}, 'qemu-kvm': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.2', 'buildtime': 1386770011L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'mom': {'release': '6.el6', 'buildtime': 1385055971L, 'version': '0.3.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['em1']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3e', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': 'd4:ae:52:c7:1e:3e', 'STP': 'no', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}, 'em2': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3f', 'cfg': {'UUID': 'c71cf0c8-07c4-49f6-aac1-b56edc3d0fe3', 'NM_CONTROLLED': 'yes', 'HWADDR': 'D4:AE:52:C7:1E:3F', 'BOOTPROTO': 'dhcp', 'DEVICE': 'em2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}}, 'software_revision': '21', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:647f414138d4', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7906', 'cpuSpeed': '3301.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.34.63.25'}} >Thread-55::DEBUG::2014-01-24 19:19:13,748::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getHardwareInfo with () {} >Thread-55::DEBUG::2014-01-24 19:19:13,771::BindingXMLRPC::976::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'PowerEdge R210 II', 'systemSerialNumber': 'J3SRJ5J', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'systemManufacturer': 'Dell Inc.'}} >Thread-56::DEBUG::2014-01-24 19:19:14,058::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {} >Thread-56::DEBUG::2014-01-24 19:19:14,059::utils::555::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-56::DEBUG::2014-01-24 19:19:14,063::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56::DEBUG::2014-01-24 19:19:14,066::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-56::DEBUG::2014-01-24 19:19:14,070::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-56::DEBUG::2014-01-24 19:19:14,082::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:647f414138d4'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384118394.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '21.git54cc674.el6', 'buildtime': 1389728033L, 'version': '4.14.0'}, 'qemu-kvm': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.2', 'buildtime': 1386770011L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'mom': {'release': '6.el6', 'buildtime': 1385055971L, 'version': '0.3.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['em1']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3e', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': 'd4:ae:52:c7:1e:3e', 'STP': 'no', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}, 'em2': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3f', 'cfg': {'UUID': 'c71cf0c8-07c4-49f6-aac1-b56edc3d0fe3', 'NM_CONTROLLED': 'yes', 'HWADDR': 'D4:AE:52:C7:1E:3F', 'BOOTPROTO': 'dhcp', 'DEVICE': 'em2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}}, 'software_revision': '21', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:647f414138d4', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7906', 'cpuSpeed': '3301.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.34.63.25'}} >Thread-57::DEBUG::2014-01-24 19:19:14,143::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getHardwareInfo with () {} >Thread-57::DEBUG::2014-01-24 19:19:14,144::BindingXMLRPC::976::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'PowerEdge R210 II', 'systemSerialNumber': 'J3SRJ5J', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'systemManufacturer': 'Dell Inc.'}} >Thread-59::DEBUG::2014-01-24 19:19:14,344::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call setMOMPolicyParameters with ({'balloonEnabled': False},) {} flowID [672728df] >Thread-12::DEBUG::2014-01-24 19:19:14,360::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:14,368::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-59::DEBUG::2014-01-24 19:19:14,408::BindingXMLRPC::976::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-12::DEBUG::2014-01-24 19:19:16,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:16,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-60::INFO::2014-01-24 19:19:17,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-60::INFO::2014-01-24 19:19:17,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:19:18,387::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:18,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:20,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:20,398::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2014-01-24 19:19:20,928::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-63::INFO::2014-01-24 19:19:20,928::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.34.63.202', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-63::DEBUG::2014-01-24 19:19:20,929::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-63::DEBUG::2014-01-24 19:19:20,939::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2014-01-24 19:19:20,939::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --discover' (cwd None) >Thread-63::DEBUG::2014-01-24 19:19:20,954::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::DEBUG::2014-01-24 19:19:20,955::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --op=delete' (cwd None) >Thread-63::DEBUG::2014-01-24 19:19:20,964::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-63::INFO::2014-01-24 19:19:20,964::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.34.63.202:3260,1 iqn.2011-01.brq.str-01:pstehlik', '10.34.63.202:3260,1 iqn.2012-06.brq.str-01:brq-setup', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:cmestreg', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:kjachim', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:lbednar', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:mbetak', '10.34.63.202:3260,1 iqn.2013-12.brq.str-01:jbelka', '10.34.63.202:3260,1 iqn.2013-12.brq.str-01:mpavlik'], 'targets': ['iqn.2011-01.brq.str-01:pstehlik', 'iqn.2012-06.brq.str-01:brq-setup', 'iqn.2012-10.brq.str-01:cmestreg', 'iqn.2012-10.brq.str-01:kjachim', 'iqn.2012-10.brq.str-01:lbednar', 'iqn.2012-10.brq.str-01:mbetak', 'iqn.2013-12.brq.str-01:jbelka', 'iqn.2013-12.brq.str-01:mpavlik']} >Thread-64::DEBUG::2014-01-24 19:19:21,411::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4930e73c] >Thread-64::INFO::2014-01-24 19:19:21,413::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-64::DEBUG::2014-01-24 19:19:21,413::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-64::DEBUG::2014-01-24 19:19:21,422::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-01-24 19:19:21,422::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None) >Thread-64::DEBUG::2014-01-24 19:19:22,040::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-01-24 19:19:22,041::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-64::DEBUG::2014-01-24 19:19:22,058::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-01-24 19:19:22,059::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0',) >Thread-64::DEBUG::2014-01-24 19:19:22,059::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain} >Thread-64::INFO::2014-01-24 19:19:22,059::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-12::DEBUG::2014-01-24 19:19:22,401::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:22,411::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:24,417::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:24,421::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-01-24 19:19:24,432::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18082755] >Thread-66::INFO::2014-01-24 19:19:24,432::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-66::DEBUG::2014-01-24 19:19:24,433::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-66::DEBUG::2014-01-24 19:19:24,446::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-01-24 19:19:24,446::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None) >Thread-66::DEBUG::2014-01-24 19:19:24,456::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-01-24 19:19:24,457::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-66::DEBUG::2014-01-24 19:19:24,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-01-24 19:19:24,465::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0',) >Thread-66::DEBUG::2014-01-24 19:19:24,465::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain} >Thread-66::INFO::2014-01-24 19:19:24,465::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-67::DEBUG::2014-01-24 19:19:24,532::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-67::INFO::2014-01-24 19:19:24,533::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-67::DEBUG::2014-01-24 19:19:24,533::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-67::DEBUG::2014-01-24 19:19:24,533::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:26,424::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:26,428::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::DEBUG::2014-01-24 19:19:27,326::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:28,431::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:28,435::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::DEBUG::2014-01-24 19:19:29,814::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::DEBUG::2014-01-24 19:19:29,815::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:30,438::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:30,442::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:32,445::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:32,450::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-70::INFO::2014-01-24 19:19:33,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-70::INFO::2014-01-24 19:19:33,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-67::DEBUG::2014-01-24 19:19:33,981::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::DEBUG::2014-01-24 19:19:34,398::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c54d5c01d2d /dev/mapper/3514f0c54d5c01d5f /dev/mapper/1cmg02 /dev/mapper/1cmg01' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:34,453::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:34,458::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:36,462::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:36,466::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:38,469::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:38,473::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-67::DEBUG::2014-01-24 19:19:40,387::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff\n Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff\n Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff\n'; <rc> = 5 >Thread-67::DEBUG::2014-01-24 19:19:40,389::lvm::859::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/1cmg01" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff', ' Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff'], unusedDevs: set(['/dev/mapper/1cmg01']), usedDevs: set(['/dev/mapper/3514f0c54d5c01d5f', '/dev/mapper/3514f0c54d5c01d2d', '/dev/mapper/1cmg02']) >Thread-67::INFO::2014-01-24 19:19:40,390::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ycYoMs-BCcs-Lkul-v2GF-V6Fy-Mbhr-LPcWAG', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'vEIhYh-t64d-rixc-zdaH-is3J-JAbn-m1ju94', 'serial': 'SXtremIO_XtremApp_92c6101061464169b0001027fc728e1b', 'GUID': '3514f0c54d5c01d2d', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ZO5XUI-KVa3-uvqI-K5ip-7zHm-xI9j-dNhA0P', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'TISsCt-PRFo-aQdO-dyEe-hZG2-M4d7-LOQYJJ', 'serial': 'SXtremIO_XtremApp_91838d02999c45b98b74def227cb4b50', 'GUID': '3514f0c54d5c01d5f', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '102005473280', 'fwrev': '0001', 'vgUUID': '2jFAnJ-0eb2-p5Jy-Qs3w-bOiW-oTPk-4o7Wcu', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'JjZ782-Z9MT-EaGF-ifdA-vAq5-5DBA-XAccgF', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg02', 'productID': 'VIRTUAL-DISK'}, {'status': 'free', 'vendorID': 'RH-str01', 'capacity': '91268055040', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'productID': 'VIRTUAL-DISK'}]} >Thread-12::DEBUG::2014-01-24 19:19:40,476::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:40,481::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-01-24 19:19:40,714::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec] >Thread-74::INFO::2014-01-24 19:19:40,715::logUtils::44::dispatcher::(wrapper) Run and protect: createVG(vgname='a250db32-9b39-4533-8bc6-926d4ae17535', devlist=['1cmg01'], force=False, options=None) >Thread-74::DEBUG::2014-01-24 19:19:40,716::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/1cmg01' (cwd None) >Thread-74::DEBUG::2014-01-24 19:19:40,826::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-01-24 19:19:40,828::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/1cmg01' (cwd None) >Thread-74::DEBUG::2014-01-24 19:19:40,954::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-01-24 19:19:40,955::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY a250db32-9b39-4533-8bc6-926d4ae17535 /dev/mapper/1cmg01' (cwd None) >Thread-74::DEBUG::2014-01-24 19:19:41,123::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-01-24 19:19:41,123::lvm::930::Storage.LVM::(createVG) Cache after createvg {'a250db32-9b39-4533-8bc6-926d4ae17535': Stub(name='a250db32-9b39-4533-8bc6-926d4ae17535', stale=True)} >Thread-74::DEBUG::2014-01-24 19:19:41,124::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:42,484::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:42,489::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-01-24 19:19:43,612::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::INFO::2014-01-24 19:19:43,613::logUtils::47::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo'} >Thread-76::DEBUG::2014-01-24 19:19:43,633::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec] >Thread-76::INFO::2014-01-24 19:19:43,633::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', domainName='iscsi_0', typeSpecificArg='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', domClass=1, domVersion='0', options=None) >Thread-76::ERROR::2014-01-24 19:19:43,633::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-76::ERROR::2014-01-24 19:19:43,633::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-76::ERROR::2014-01-24 19:19:43,635::sdc::143::Storage.StorageDomainCache::(_findDomain) domain a250db32-9b39-4533-8bc6-926d4ae17535 not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('a250db32-9b39-4533-8bc6-926d4ae17535',) >Thread-76::INFO::2014-01-24 19:19:43,635::blockSD::492::Storage.StorageDomain::(create) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 domainName=iscsi_0 domClass=1 vgUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo storageType=3 version=0 >Thread-76::DEBUG::2014-01-24 19:19:43,635::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:44,493::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:44,497::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:46,500::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:46,504::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-78::INFO::2014-01-24 19:19:48,343::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2014-01-24 19:19:48,344::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:19:48,507::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:48,511::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:19:50,513::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:50,518::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:51,548::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:51,551::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-76::DEBUG::2014-01-24 19:19:51,648::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:51,648::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-76::INFO::2014-01-24 19:19:51,649::blockSD::476::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-76::DEBUG::2014-01-24 19:19:51,649::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-76::DEBUG::2014-01-24 19:19:51,779::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:51,781::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:52,521::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:52,525::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:53,983::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:53,984::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-76::DEBUG::2014-01-24 19:19:53,985::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:54,528::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:54,532::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:56,245::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::INFO::2014-01-24 19:19:56,246::blockSD::665::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/1cmg01'] >Thread-76::DEBUG::2014-01-24 19:19:56,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:56,535::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:56,539::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:58,473::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:58,474::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:58,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:19:58,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:58,589::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:58,590::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases' (cwd None) >Thread-76::DEBUG::2014-01-24 19:19:58,598::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:19:58,599::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:00,551::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:00,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:00,927::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:00,928::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/ids' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:00,936::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:00,936::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:02,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:02,563::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:03,172::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:03,174::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-84::INFO::2014-01-24 19:20:03,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-84::INFO::2014-01-24 19:20:03,836::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:20:04,566::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:04,570::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:05,693::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:05,694::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:06,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:06,577::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:07,911::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:07,912::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:07,921::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:07,921::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:08,580::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:08,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:08,756::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:08,756::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:10,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:10,591::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:11,272::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:11,274::blockSD::544::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:11,874::blockSD::544::Storage.Misc.excCmd::(create) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.59533 s, 70.5 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:11,874::misc::287::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.59533 s, 70.5 MB/s'], size: 41943040 >Thread-76::DEBUG::2014-01-24 19:20:11,876::blockSD::546::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:11,892::blockSD::546::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112691 s, 90.9 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:11,892::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.0112691 s, 90.9 MB/s'], size: 1024000 >Thread-76::DEBUG::2014-01-24 19:20:11,894::blockSD::548::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:11,908::blockSD::548::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00981574 s, 104 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:11,909::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00981574 s, 104 MB/s'], size: 1024000 >Thread-76::DEBUG::2014-01-24 19:20:11,909::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-76::DEBUG::2014-01-24 19:20:11,910::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:12,594::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:12,598::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:14,138::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:14,141::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:14,145::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000531357 s, 3.9 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:14,145::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000531357 s, 3.9 MB/s'], size: 2048 >Thread-76::DEBUG::2014-01-24 19:20:14,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-76::WARNING::2014-01-24 19:20:14,146::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-76::DEBUG::2014-01-24 19:20:14,148::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-76::DEBUG::2014-01-24 19:20:14,149::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:14,308::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:14,308::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-76::DEBUG::2014-01-24 19:20:14,310::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-76::DEBUG::2014-01-24 19:20:14,315::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602573 s, 3.4 MB/s\n'; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:14,315::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602573 s, 3.4 MB/s'], size: 2048 >Thread-76::DEBUG::2014-01-24 19:20:14,315::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-76::DEBUG::2014-01-24 19:20:14,316::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:14,601::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:14,605::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:16,525::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:16,526::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:16,608::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:16,612::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:18,615::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:18,619::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:18,733::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:18,734::clusterlock::65::Storage.Misc.excCmd::(initLock) '/usr/libexec/vdsm/safelease release -f /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 0' (cwd /usr/libexec/vdsm) >Thread-76::DEBUG::2014-01-24 19:20:18,739::clusterlock::65::Storage.Misc.excCmd::(initLock) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-01-24 19:20:18,739::sd::424::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-76::DEBUG::2014-01-24 19:20:18,739::hsm::2592::Storage.HSM::(createStorageDomain) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain} >Thread-76::INFO::2014-01-24 19:20:18,739::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-90::DEBUG::2014-01-24 19:20:18,797::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec] >Thread-90::INFO::2014-01-24 19:20:18,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', options=None) >Thread-90::DEBUG::2014-01-24 19:20:18,800::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-90::DEBUG::2014-01-24 19:20:18,801::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-90::DEBUG::2014-01-24 19:20:18,806::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000600814 s, 3.4 MB/s\n'; <rc> = 0 >Thread-90::DEBUG::2014-01-24 19:20:18,806::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000600814 s, 3.4 MB/s'], size: 2048 >Thread-90::DEBUG::2014-01-24 19:20:18,806::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-90::DEBUG::2014-01-24 19:20:18,807::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-91::INFO::2014-01-24 19:20:19,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2014-01-24 19:20:19,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:20:20,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:20,627::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-90::DEBUG::2014-01-24 19:20:21,009::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-90::INFO::2014-01-24 19:20:21,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '86704652288', 'disktotal': '90865401856', 'mdafree': '67105280'}} >Thread-93::DEBUG::2014-01-24 19:20:21,104::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec] >Thread-93::INFO::2014-01-24 19:20:21,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None) >Thread-93::INFO::2014-01-24 19:20:21,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-12::DEBUG::2014-01-24 19:20:22,630::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:22,634::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-01-24 19:20:22,664::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [2bacde35] >Thread-95::INFO::2014-01-24 19:20:22,664::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90', 'port': '3260'}], options=None) >Thread-95::DEBUG::2014-01-24 19:20:22,665::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-95::DEBUG::2014-01-24 19:20:22,675::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-01-24 19:20:22,675::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None) >Thread-95::DEBUG::2014-01-24 19:20:22,685::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-01-24 19:20:22,685::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-95::DEBUG::2014-01-24 19:20:22,693::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-01-24 19:20:22,693::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a250db32-9b39-4533-8bc6-926d4ae17535', 'c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '6116a097-264f-40f2-9c37-b0a1d79b1dd2') >Thread-95::DEBUG::2014-01-24 19:20:22,694::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-95::INFO::2014-01-24 19:20:22,694::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90'}]} >Thread-96::DEBUG::2014-01-24 19:20:22,715::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3f91059e] >Thread-96::INFO::2014-01-24 19:20:22,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None) >Thread-96::INFO::2014-01-24 19:20:22,724::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-97::DEBUG::2014-01-24 19:20:22,767::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3f91059e] >Thread-97::INFO::2014-01-24 19:20:22,767::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', poolName='datacenter_iscsiTestStorage', masterDom='a250db32-9b39-4533-8bc6-926d4ae17535', domList=['a250db32-9b39-4533-8bc6-926d4ae17535'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-97::DEBUG::2014-01-24 19:20:22,768::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-97::DEBUG::2014-01-24 19:20:22,768::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:24,637::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:24,641::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:24,856::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:26,644::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:26,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:27,676::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:27,678::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:28,662::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:28,667::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:29,939::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:29,940::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-97::DEBUG::2014-01-24 19:20:29,942::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:29,947::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000480369 s, 4.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:29,947::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000480369 s, 4.3 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:29,947::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-97::INFO::2014-01-24 19:20:29,948::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-97::INFO::2014-01-24 19:20:29,948::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-97::INFO::2014-01-24 19:20:29,948::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-97::INFO::2014-01-24 19:20:29,948::blockSD::851::Storage.StorageDomain::(validate) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::DEBUG::2014-01-24 19:20:29,949::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,044::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,045::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,050::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000575052 s, 3.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,051::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000575052 s, 3.6 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:30,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-97::INFO::2014-01-24 19:20:30,052::sp::597::Storage.StoragePool::(create) spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 poolName=datacenter_iscsiTestStorage master_sd=a250db32-9b39-4533-8bc6-926d4ae17535 domList=['a250db32-9b39-4533-8bc6-926d4ae17535'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-97::INFO::2014-01-24 19:20:30,052::blockSD::851::Storage.StorageDomain::(validate) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::DEBUG::2014-01-24 19:20:30,053::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,147::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,149::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,154::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000538097 s, 3.8 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,154::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000538097 s, 3.8 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:30,154::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-97::DEBUG::2014-01-24 19:20:30,156::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,161::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000608133 s, 3.4 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,161::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000608133 s, 3.4 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:30,161::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-97::DEBUG::2014-01-24 19:20:30,162::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-97::DEBUG::2014-01-24 19:20:30,162::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-97::WARNING::2014-01-24 19:20:30,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists >Thread-97::WARNING::2014-01-24 19:20:30,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists >Thread-97::DEBUG::2014-01-24 19:20:30,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-97::DEBUG::2014-01-24 19:20:30,164::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:30,169::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000528076 s, 3.9 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:30,169::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000528076 s, 3.9 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:30,169::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd'] >Thread-97::DEBUG::2014-01-24 19:20:30,170::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start a250db32-9b39-4533-8bc6-926d4ae17535 1000 5 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-12::DEBUG::2014-01-24 19:20:30,670::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:30,674::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:32,677::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:32,681::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-101::INFO::2014-01-24 19:20:34,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-101::INFO::2014-01-24 19:20:34,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:20:34,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:34,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:36,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:36,696::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:38,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:38,709::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:40,712::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:40,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:42,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:42,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:44,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:44,730::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:46,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:46,749::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:48,752::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:48,756::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-107::INFO::2014-01-24 19:20:49,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-107::INFO::2014-01-24 19:20:49,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-97::DEBUG::2014-01-24 19:20:50,192::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::INFO::2014-01-24 19:20:50,192::sp::730::Storage.StoragePool::(createMaster) setting master domain for spUUID 3ea3dad7-383a-417b-b9b7-63ce4660f638 on sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::DEBUG::2014-01-24 19:20:50,192::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-97::DEBUG::2014-01-24 19:20:50,192::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-97::DEBUG::2014-01-24 19:20:50,193::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=781fccff42158744318154713a2298f98a442696'] >Thread-97::DEBUG::2014-01-24 19:20:50,195::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-97::DEBUG::2014-01-24 19:20:50,197::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:50,202::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000555206 s, 3.7 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:50,202::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000555206 s, 3.7 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=781fccff42158744318154713a2298f98a442696'] >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-97::DEBUG::2014-01-24 19:20:50,204::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-97::DEBUG::2014-01-24 19:20:50,206::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-97::DEBUG::2014-01-24 19:20:50,206::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1 >Thread-97::DEBUG::2014-01-24 19:20:50,208::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:50,213::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000384443 s, 5.3 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:50,213::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000384443 s, 5.3 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:50,214::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-97::INFO::2014-01-24 19:20:50,214::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::DEBUG::2014-01-24 19:20:50,214::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `a250db32-9b39-4533-8bc6-926d4ae17535` >Thread-109::DEBUG::2014-01-24 19:20:50,214::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::WARNING::2014-01-24 19:20:50,215::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists >Thread-109::DEBUG::2014-01-24 19:20:50,219::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:50,225::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:50,230::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000269593 s, 7.6 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:50,230::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000269593 s, 7.6 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:50,231::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-97::DEBUG::2014-01-24 19:20:50,232::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:50,759::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:50,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:20:52,770::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:52,774::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-01-24 19:20:53,200::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-01-24 19:20:53,202::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-109::DEBUG::2014-01-24 19:20:53,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000530128 s, 7.7 MB/s\n'; <rc> = 0 >Thread-109::DEBUG::2014-01-24 19:20:53,208::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:54,777::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:54,781::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-01-24 19:20:55,573::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-01-24 19:20:55,575::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain a250db32-9b39-4533-8bc6-926d4ae17535 changed its status to Valid >Thread-97::DEBUG::2014-01-24 19:20:56,631::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::WARNING::2014-01-24 19:20:56,634::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists >Thread-97::WARNING::2014-01-24 19:20:56,634::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists >Thread-97::INFO::2014-01-24 19:20:56,634::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::INFO::2014-01-24 19:20:56,634::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd >Thread-97::DEBUG::2014-01-24 19:20:56,635::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh a250db32-9b39-4533-8bc6-926d4ae17535' (cwd /usr/libexec/vdsm) >Thread-12::DEBUG::2014-01-24 19:20:56,784::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:56,788::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:57,651::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:57,653::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-97::DEBUG::2014-01-24 19:20:57,658::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000593483 s, 3.5 MB/s\n'; <rc> = 0 >Thread-97::DEBUG::2014-01-24 19:20:57,658::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000593483 s, 3.5 MB/s'], size: 2048 >Thread-97::DEBUG::2014-01-24 19:20:57,658::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-97::INFO::2014-01-24 19:20:57,658::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-109::DEBUG::2014-01-24 19:20:57,658::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-97::INFO::2014-01-24 19:20:57,659::logUtils::47::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-112::DEBUG::2014-01-24 19:20:57,772::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [60b4788] >Thread-112::INFO::2014-01-24 19:20:57,773::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90', 'port': '3260'}], options=None) >Thread-112::DEBUG::2014-01-24 19:20:57,773::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None) >Thread-112::DEBUG::2014-01-24 19:20:57,783::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-112::DEBUG::2014-01-24 19:20:57,784::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None) >Thread-112::DEBUG::2014-01-24 19:20:57,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-112::DEBUG::2014-01-24 19:20:57,793::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-112::DEBUG::2014-01-24 19:20:57,801::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-112::DEBUG::2014-01-24 19:20:57,801::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a250db32-9b39-4533-8bc6-926d4ae17535', 'c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '6116a097-264f-40f2-9c37-b0a1d79b1dd2') >Thread-112::DEBUG::2014-01-24 19:20:57,803::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-112::INFO::2014-01-24 19:20:57,803::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90'}]} >Thread-113::DEBUG::2014-01-24 19:20:57,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7dd5dbdd] >Thread-113::INFO::2014-01-24 19:20:57,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None) >Thread-113::DEBUG::2014-01-24 19:20:57,887::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:58,791::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:20:58,796::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-113::DEBUG::2014-01-24 19:21:00,078::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-113::INFO::2014-01-24 19:21:00,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-115::DEBUG::2014-01-24 19:21:00,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-115::INFO::2014-01-24 19:21:00,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-115::ERROR::2014-01-24 19:21:00,194::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('3ea3dad7-383a-417b-b9b7-63ce4660f638',)", 'code': 309}} >Thread-116::DEBUG::2014-01-24 19:21:00,234::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-116::INFO::2014-01-24 19:21:00,234::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', hostID=1, msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None) >Thread-116::INFO::2014-01-24 19:21:00,235::sp::672::Storage.StoragePool::(connect) Connect host #1 to the storage pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 with master domain: a250db32-9b39-4533-8bc6-926d4ae17535 (ver = 1) >Thread-116::DEBUG::2014-01-24 19:21:00,236::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-116::DEBUG::2014-01-24 19:21:00,236::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:00,799::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:00,803::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:02,406::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:02,806::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:02,811::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:21:04,813::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:04,825::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:05,042::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:05,045::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-118::INFO::2014-01-24 19:21:05,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-118::INFO::2014-01-24 19:21:05,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-12::DEBUG::2014-01-24 19:21:06,829::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:06,834::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:07,505::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:07,507::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-116::DEBUG::2014-01-24 19:21:07,510::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:07,514::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000553837 s, 3.7 MB/s\n'; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:07,515::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000553837 s, 3.7 MB/s'], size: 2048 >Thread-116::DEBUG::2014-01-24 19:21:07,515::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-116::INFO::2014-01-24 19:21:07,515::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-116::INFO::2014-01-24 19:21:07,516::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-116::INFO::2014-01-24 19:21:07,516::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-116::DEBUG::2014-01-24 19:21:07,516::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1 >Thread-116::DEBUG::2014-01-24 19:21:07,518::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:07,522::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000567966 s, 3.6 MB/s\n'; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:07,522::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000567966 s, 3.6 MB/s'], size: 2048 >Thread-116::DEBUG::2014-01-24 19:21:07,523::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-116::INFO::2014-01-24 19:21:07,523::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-120::DEBUG::2014-01-24 19:21:07,523::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-116::DEBUG::2014-01-24 19:21:07,523::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `a250db32-9b39-4533-8bc6-926d4ae17535` >Thread-116::WARNING::2014-01-24 19:21:07,524::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists >Thread-120::DEBUG::2014-01-24 19:21:07,526::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:07,532::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:07,537::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000632904 s, 3.2 MB/s\n'; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:07,538::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000632904 s, 3.2 MB/s'], size: 2048 >Thread-116::DEBUG::2014-01-24 19:21:07,538::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >Thread-116::DEBUG::2014-01-24 19:21:07,539::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:07,626::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:21:07,628::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:07,633::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554324 s, 7.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:21:07,634::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain a250db32-9b39-4533-8bc6-926d4ae17535 changed its status to Valid >Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-122::INFO::2014-01-24 19:21:07,640::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-12::DEBUG::2014-01-24 19:21:08,837::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:08,841::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:21:10,844::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:10,848::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:21:12,851::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:12,855::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:13,621::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::WARNING::2014-01-24 19:21:13,624::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists >Thread-116::WARNING::2014-01-24 19:21:13,624::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists >Thread-116::INFO::2014-01-24 19:21:13,624::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-116::INFO::2014-01-24 19:21:13,624::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd >Thread-116::DEBUG::2014-01-24 19:21:13,626::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:13,634::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00346274 s, 1.2 MB/s\n'; <rc> = 0 >Thread-116::INFO::2014-01-24 19:21:13,634::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-116::DEBUG::2014-01-24 19:21:13,635::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-116::DEBUG::2014-01-24 19:21:14,640::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00139 s, 4.1 kB/s\n'; <rc> = 0 >Thread-116::DEBUG::2014-01-24 19:21:14,640::storage_mailbox::209::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 >Thread-116::DEBUG::2014-01-24 19:21:14,641::sp::491::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 on master domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-116::INFO::2014-01-24 19:21:14,641::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-132::DEBUG::2014-01-24 19:21:14,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-132::INFO::2014-01-24 19:21:14,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-132::INFO::2014-01-24 19:21:14,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-133::DEBUG::2014-01-24 19:21:14,724::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-133::INFO::2014-01-24 19:21:14,724::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', prevID=-1, prevLVER='-1', maxHostID=250, domVersion='3', options=None) >Thread-133::INFO::2014-01-24 19:21:14,725::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,730::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,735::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000635366 s, 3.2 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,736::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000635366 s, 3.2 MB/s'], size: 2048 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,736::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:14,736::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists >7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:14,736::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,737::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,739::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000535917 s, 3.8 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000535917 s, 3.8 MB/s'], size: 2048 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,745::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start a250db32-9b39-4533-8bc6-926d4ae17535 1 5 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Thread-12::DEBUG::2014-01-24 19:21:14,858::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:14,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-134::DEBUG::2014-01-24 19:21:15,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-134::INFO::2014-01-24 19:21:15,752::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-134::INFO::2014-01-24 19:21:15,752::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-135::DEBUG::2014-01-24 19:21:16,761::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-135::INFO::2014-01-24 19:21:16,761::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-135::INFO::2014-01-24 19:21:16,761::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:16,866::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:16,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:21:17,635::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-137::DEBUG::2014-01-24 19:21:17,770::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-137::INFO::2014-01-24 19:21:17,771::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-137::INFO::2014-01-24 19:21:17,771::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-138::DEBUG::2014-01-24 19:21:18,826::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-138::INFO::2014-01-24 19:21:18,827::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-138::INFO::2014-01-24 19:21:18,827::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:18,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:18,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-139::DEBUG::2014-01-24 19:21:19,834::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-139::INFO::2014-01-24 19:21:19,835::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-139::INFO::2014-01-24 19:21:19,835::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:21:19,905::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:21:19,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:19,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060657 s, 6.8 MB/s\n'; <rc> = 0 >Thread-140::INFO::2014-01-24 19:21:20,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-140::INFO::2014-01-24 19:21:20,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060657', 'lastCheck': '0.5', 'valid': True}} >Thread-142::DEBUG::2014-01-24 19:21:20,866::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-142::INFO::2014-01-24 19:21:20,867::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-142::INFO::2014-01-24 19:21:20,867::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:20,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:20,885::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-143::DEBUG::2014-01-24 19:21:21,883::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-143::INFO::2014-01-24 19:21:21,883::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-143::INFO::2014-01-24 19:21:21,883::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:22,888::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:22,892::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-144::DEBUG::2014-01-24 19:21:22,903::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-144::INFO::2014-01-24 19:21:22,903::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-144::INFO::2014-01-24 19:21:22,904::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-146::DEBUG::2014-01-24 19:21:23,912::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-146::INFO::2014-01-24 19:21:23,913::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-146::INFO::2014-01-24 19:21:23,913::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:24,895::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:24,899::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-147::DEBUG::2014-01-24 19:21:24,920::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-147::INFO::2014-01-24 19:21:24,921::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-147::INFO::2014-01-24 19:21:24,921::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-148::DEBUG::2014-01-24 19:21:25,929::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-148::INFO::2014-01-24 19:21:25,929::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-148::INFO::2014-01-24 19:21:25,929::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:26,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:26,907::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-150::DEBUG::2014-01-24 19:21:26,959::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-150::INFO::2014-01-24 19:21:26,959::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-150::INFO::2014-01-24 19:21:26,959::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-151::DEBUG::2014-01-24 19:21:27,976::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-151::INFO::2014-01-24 19:21:27,977::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-151::INFO::2014-01-24 19:21:27,977::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:28,909::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:28,914::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-152::DEBUG::2014-01-24 19:21:28,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-152::INFO::2014-01-24 19:21:28,990::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-152::INFO::2014-01-24 19:21:28,990::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:21:29,916::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:29,921::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638998 s, 6.4 MB/s\n'; <rc> = 0 >Thread-154::DEBUG::2014-01-24 19:21:30,012::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-154::INFO::2014-01-24 19:21:30,012::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-154::INFO::2014-01-24 19:21:30,012::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:30,917::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:30,921::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-155::DEBUG::2014-01-24 19:21:31,028::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-155::INFO::2014-01-24 19:21:31,029::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-155::INFO::2014-01-24 19:21:31,029::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-156::DEBUG::2014-01-24 19:21:32,036::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-156::INFO::2014-01-24 19:21:32,037::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-156::INFO::2014-01-24 19:21:32,037::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:32,924::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:32,928::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-158::DEBUG::2014-01-24 19:21:33,044::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-158::INFO::2014-01-24 19:21:33,046::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-158::INFO::2014-01-24 19:21:33,046::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-159::DEBUG::2014-01-24 19:21:34,056::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-159::INFO::2014-01-24 19:21:34,056::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-159::INFO::2014-01-24 19:21:34,057::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,767::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,768::sp::298::Storage.StoragePool::(startSpm) spm lock acquired successfully >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,769::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000498448 s, 4.1 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000498448 s, 4.1 MB/s'], size: 2048 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,776::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,776::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=04f7a07d85b49c7704704d966d6492eaada87243'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,778::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:21:34,779::sp::462::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `a250db32-9b39-4533-8bc6-926d4ae17535` >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::97::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain a250db32-9b39-4533-8bc6-926d4ae17535 from version 0 to version 3 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::107::Storage.v3DomainConverter::(v3DomainConverter) Upgrading domain a250db32-9b39-4533-8bc6-926d4ae17535 from version 0 to version 2 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::81::Storage.v2DomainConverter::(v2DomainConverter) Trying to upgrade domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata version 2 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,781::formatConverter::43::Storage.DomainMetadataToTags::(__convertDomainMetadataToTags) Converting domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:34,931::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:34,936::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-160::DEBUG::2014-01-24 19:21:35,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-160::INFO::2014-01-24 19:21:35,064::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-160::INFO::2014-01-24 19:21:35,064::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-161::INFO::2014-01-24 19:21:35,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-161::INFO::2014-01-24 19:21:35,633::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000638998', 'lastCheck': '5.7', 'valid': True}} >Thread-163::DEBUG::2014-01-24 19:21:36,072::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-163::INFO::2014-01-24 19:21:36,072::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-163::INFO::2014-01-24 19:21:36,073::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:36,939::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:36,943::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-164::DEBUG::2014-01-24 19:21:37,082::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-164::INFO::2014-01-24 19:21:37,082::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-164::INFO::2014-01-24 19:21:37,082::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,525::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:37,526::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=2', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,527::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-165::DEBUG::2014-01-24 19:21:38,090::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-165::INFO::2014-01-24 19:21:38,091::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-165::INFO::2014-01-24 19:21:38,091::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:38,946::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:38,950::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-167::DEBUG::2014-01-24 19:21:39,098::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-167::INFO::2014-01-24 19:21:39,098::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-167::INFO::2014-01-24 19:21:39,099::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:21:39,924::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-168::DEBUG::2014-01-24 19:21:40,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-168::INFO::2014-01-24 19:21:40,139::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-168::INFO::2014-01-24 19:21:40,140::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:40,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:40,958::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-169::DEBUG::2014-01-24 19:21:41,155::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-169::INFO::2014-01-24 19:21:41,155::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-169::INFO::2014-01-24 19:21:41,155::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-171::DEBUG::2014-01-24 19:21:42,170::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-171::INFO::2014-01-24 19:21:42,171::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-171::INFO::2014-01-24 19:21:42,171::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:42,413::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:42,415::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo --addtag MDT_SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535 --addtag MDT_ROLE=Master --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active --addtag MDT_VERSION=2 --addtag MDT_PV0=pv:1cmg01&44&uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30&44&pestart:0&44&pecount:677&44&mapoffset:0 --addtag MDT_LOCKPOLICY= --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT_CLASS=Data --addtag MDT_DESCRIPTION=iscsi_0 --addtag MDT_LEASETIMESEC=60 --addtag MDT_MASTER_VERSION=1 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_POOL_DESCRIPTION=datacenter_iscsiTestStorage --addtag MDT_POOL_SPM_ID=1 --addtag MDT_TYPE=ISCSI --addtag MDT_LOGBLKSIZE=512 --addtag MDT_LEASERETRIES=3 --addtag MDT_PHYBLKSIZE=512 --addtag MDT_POOL_SPM_LVER=0 --addtag MDT__SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c --addtag MDT_POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:42,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:42,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-172::DEBUG::2014-01-24 19:21:43,179::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-172::INFO::2014-01-24 19:21:43,179::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-172::INFO::2014-01-24 19:21:43,179::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:21:43,332::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:21:43,334::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:43,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000363179 s, 11.3 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,419::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,419::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,422::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,422::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,424::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000411406 s, 5.0 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000411406 s, 5.0 MB/s'], size: 2048 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,430::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-173::DEBUG::2014-01-24 19:21:44,187::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-173::INFO::2014-01-24 19:21:44,188::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-173::INFO::2014-01-24 19:21:44,188::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:44,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:44,972::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-175::DEBUG::2014-01-24 19:21:45,195::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-175::INFO::2014-01-24 19:21:45,195::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-175::INFO::2014-01-24 19:21:45,196::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,635::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,636::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'VERSION=2', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', '_SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,637::formatConverter::65::Storage.DomainMetadataToTags::(__convertDomainMetadataToTags) Conversion of domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata completed, target version = 2 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,637::formatConverter::120::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,726::formatConverter::124::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-176::DEBUG::2014-01-24 19:21:46,202::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-176::INFO::2014-01-24 19:21:46,203::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-176::INFO::2014-01-24 19:21:46,203::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:46,975::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:46,980::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-177::DEBUG::2014-01-24 19:21:47,214::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-177::INFO::2014-01-24 19:21:47,215::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-177::INFO::2014-01-24 19:21:47,215::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-179::DEBUG::2014-01-24 19:21:48,229::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-179::INFO::2014-01-24 19:21:48,229::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-179::INFO::2014-01-24 19:21:48,229::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:48,983::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:48,987::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-180::DEBUG::2014-01-24 19:21:49,237::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-180::INFO::2014-01-24 19:21:49,237::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-180::INFO::2014-01-24 19:21:49,237::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-181::DEBUG::2014-01-24 19:21:50,247::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-181::INFO::2014-01-24 19:21:50,248::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-181::INFO::2014-01-24 19:21:50,248::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-182::INFO::2014-01-24 19:21:50,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-182::INFO::2014-01-24 19:21:50,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363179', 'lastCheck': '7.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:21:50,990::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:50,994::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-184::DEBUG::2014-01-24 19:21:51,255::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-184::INFO::2014-01-24 19:21:51,255::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-184::INFO::2014-01-24 19:21:51,256::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-185::DEBUG::2014-01-24 19:21:52,263::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-185::INFO::2014-01-24 19:21:52,264::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-185::INFO::2014-01-24 19:21:52,264::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:52,997::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:53,002::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-186::DEBUG::2014-01-24 19:21:53,273::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-186::INFO::2014-01-24 19:21:53,273::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-186::INFO::2014-01-24 19:21:53,274::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:21:53,343::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:21:53,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605733 s, 6.8 MB/s\n'; <rc> = 0 >Thread-188::DEBUG::2014-01-24 19:21:54,299::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-188::INFO::2014-01-24 19:21:54,300::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-188::INFO::2014-01-24 19:21:54,300::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:55,005::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:55,009::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-189::DEBUG::2014-01-24 19:21:55,307::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-189::INFO::2014-01-24 19:21:55,308::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-189::INFO::2014-01-24 19:21:55,308::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-190::DEBUG::2014-01-24 19:21:56,333::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-190::INFO::2014-01-24 19:21:56,333::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-190::INFO::2014-01-24 19:21:56,333::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:57,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:57,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2014-01-24 19:21:57,348::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-192::INFO::2014-01-24 19:21:57,348::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-192::INFO::2014-01-24 19:21:57,348::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-193::DEBUG::2014-01-24 19:21:58,377::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-193::INFO::2014-01-24 19:21:58,377::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-193::INFO::2014-01-24 19:21:58,377::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:21:59,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:21:59,024::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-194::DEBUG::2014-01-24 19:21:59,408::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-194::INFO::2014-01-24 19:21:59,408::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-194::INFO::2014-01-24 19:21:59,409::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-196::DEBUG::2014-01-24 19:22:00,416::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-196::INFO::2014-01-24 19:22:00,416::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-196::INFO::2014-01-24 19:22:00,416::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:01,027::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:01,031::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-197::DEBUG::2014-01-24 19:22:01,427::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-197::INFO::2014-01-24 19:22:01,427::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-197::INFO::2014-01-24 19:22:01,427::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-198::DEBUG::2014-01-24 19:22:02,435::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-198::INFO::2014-01-24 19:22:02,435::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-198::INFO::2014-01-24 19:22:02,435::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:03,034::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:03,039::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:03,351::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:03,356::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636078 s, 6.4 MB/s\n'; <rc> = 0 >Thread-200::DEBUG::2014-01-24 19:22:03,442::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-200::INFO::2014-01-24 19:22:03,443::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-200::INFO::2014-01-24 19:22:03,443::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-201::DEBUG::2014-01-24 19:22:04,450::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-201::INFO::2014-01-24 19:22:04,450::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-201::INFO::2014-01-24 19:22:04,450::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:05,042::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:05,046::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-202::DEBUG::2014-01-24 19:22:05,470::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-202::INFO::2014-01-24 19:22:05,470::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-202::INFO::2014-01-24 19:22:05,471::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-203::INFO::2014-01-24 19:22:06,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-203::INFO::2014-01-24 19:22:06,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 2, 'acquired': True, 'delay': '0.000636078', 'lastCheck': '2.7', 'valid': True}} >Thread-205::DEBUG::2014-01-24 19:22:06,479::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-205::INFO::2014-01-24 19:22:06,479::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-205::INFO::2014-01-24 19:22:06,479::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,729::formatConverter::201::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535 with host id: 1 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,792::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,887::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::formatConverter::167::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) Starting metadata reallocation check for domain a250db32-9b39-4533-8bc6-926d4ae17535 with metaMaxSlot 1947 (leases volume size 2048) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::formatConverter::306::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 2 to version 3 for domain a250db32-9b39-4533-8bc6-926d4ae17535 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,892::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,892::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:07,049::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:07,054::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-206::DEBUG::2014-01-24 19:22:07,489::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-206::INFO::2014-01-24 19:22:07,490::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-206::INFO::2014-01-24 19:22:07,490::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-207::DEBUG::2014-01-24 19:22:08,505::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-207::INFO::2014-01-24 19:22:08,506::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-207::INFO::2014-01-24 19:22:08,506::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,045::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,047::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c --deltag MDT_VERSION=2 --addtag MDT_VERSION=3 --addtag MDT__SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:09,057::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:09,063::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,228::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,229::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,229::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh a250db32-9b39-4533-8bc6-926d4ae17535' (cwd /usr/libexec/vdsm) >Thread-209::DEBUG::2014-01-24 19:22:09,513::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-209::INFO::2014-01-24 19:22:09,513::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-209::INFO::2014-01-24 19:22:09,513::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,245::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,245::formatConverter::344::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-210::DEBUG::2014-01-24 19:22:10,521::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-210::INFO::2014-01-24 19:22:10,521::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-210::INFO::2014-01-24 19:22:10,522::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:11,068::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:11,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-211::DEBUG::2014-01-24 19:22:11,528::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-211::INFO::2014-01-24 19:22:11,529::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-211::INFO::2014-01-24 19:22:11,529::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-213::DEBUG::2014-01-24 19:22:12,536::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-213::INFO::2014-01-24 19:22:12,536::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-213::INFO::2014-01-24 19:22:12,536::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:13,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:13,080::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-214::DEBUG::2014-01-24 19:22:13,574::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-214::INFO::2014-01-24 19:22:13,574::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-214::INFO::2014-01-24 19:22:13,574::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-215::DEBUG::2014-01-24 19:22:14,601::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-215::INFO::2014-01-24 19:22:14,601::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-215::INFO::2014-01-24 19:22:14,601::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,969::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,970::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,972::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,977::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000639183 s, 3.2 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000639183 s, 3.2 MB/s'], size: 2048 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,979::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:15,083::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:15,088::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-217::DEBUG::2014-01-24 19:22:15,639::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-217::INFO::2014-01-24 19:22:15,639::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-217::INFO::2014-01-24 19:22:15,639::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-218::DEBUG::2014-01-24 19:22:16,654::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-218::INFO::2014-01-24 19:22:16,654::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-218::INFO::2014-01-24 19:22:16,654::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:17,091::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:17,095::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,600::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,601::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,604::sp::467::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >Thread-120::DEBUG::2014-01-24 19:22:17,606::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,612::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-219::DEBUG::2014-01-24 19:22:17,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-219::INFO::2014-01-24 19:22:17,663::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-219::INFO::2014-01-24 19:22:17,664::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-120::DEBUG::2014-01-24 19:22:17,703::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:17,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:17,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600893 s, 6.8 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:17,711::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-221::DEBUG::2014-01-24 19:22:18,671::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-221::INFO::2014-01-24 19:22:18,671::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-221::INFO::2014-01-24 19:22:18,671::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:19,098::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:19,102::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-222::DEBUG::2014-01-24 19:22:19,678::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-222::INFO::2014-01-24 19:22:19,679::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-222::INFO::2014-01-24 19:22:19,679::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,654::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,655::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,656::sp::474::Storage.StoragePool::(_upgradePool) Registering with state change event >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,656::sp::477::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,657::blockSD::1137::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >Thread-223::DEBUG::2014-01-24 19:22:20,695::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-223::INFO::2014-01-24 19:22:20,696::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-223::INFO::2014-01-24 19:22:20,696::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,698::blockSD::1137::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,699::blockSD::1162::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,707::blockSD::1162::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,708::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,724::blockSD::1174::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,736::blockSD::1174::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,736::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master/vms >Thread-120::DEBUG::2014-01-24 19:22:20,750::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,824::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master/tasks >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,827::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:21,105::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:21,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-224::INFO::2014-01-24 19:22:21,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-224::INFO::2014-01-24 19:22:21,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 2, 'acquired': True, 'delay': '0.000636078', 'lastCheck': '18.0', 'valid': True}} >Thread-226::DEBUG::2014-01-24 19:22:21,704::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-226::INFO::2014-01-24 19:22:21,704::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-226::INFO::2014-01-24 19:22:21,704::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-227::DEBUG::2014-01-24 19:22:22,711::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-227::INFO::2014-01-24 19:22:22,712::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-227::INFO::2014-01-24 19:22:22,712::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-12::DEBUG::2014-01-24 19:22:23,116::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:23,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,208::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,209::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,211::storage_mailbox::576::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,212::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,247::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306956 s, 33.4 MB/s\n'; <rc> = 0 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,248::storage_mailbox::584::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,248::sp::349::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 on master domain a250db32-9b39-4533-8bc6-926d4ae17535 >7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,249::sp::357::Storage.StoragePool::(startSpm) ended. >Dummy-233::DEBUG::2014-01-24 19:22:23,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:23,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284332 s, 36.0 MB/s\n'; <rc> = 0 >Thread-234::DEBUG::2014-01-24 19:22:23,719::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-234::INFO::2014-01-24 19:22:23,719::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-234::INFO::2014-01-24 19:22:23,719::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}} >Thread-235::DEBUG::2014-01-24 19:22:23,726::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-235::INFO::2014-01-24 19:22:23,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-235::INFO::2014-01-24 19:22:23,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-236::DEBUG::2014-01-24 19:22:23,739::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-236::INFO::2014-01-24 19:22:23,740::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None) >Thread-236::INFO::2014-01-24 19:22:23,740::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-237::DEBUG::2014-01-24 19:22:23,840::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-237::INFO::2014-01-24 19:22:23,840::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-237::INFO::2014-01-24 19:22:23,842::sp::1060::Storage.StoragePool::(activateSD) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 >Thread-237::INFO::2014-01-24 19:22:23,842::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-238::DEBUG::2014-01-24 19:22:23,899::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716] >Thread-238::INFO::2014-01-24 19:22:23,899::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', hostID=1, msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None) >Thread-238::DEBUG::2014-01-24 19:22:23,901::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-238::DEBUG::2014-01-24 19:22:23,901::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:25,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:25,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:25,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:25,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266606 s, 38.4 MB/s\n'; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:25,999::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:27,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:27,141::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:27,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:27,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270166 s, 37.9 MB/s\n'; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:28,576::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:28,578::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:29,144::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:29,150::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:29,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:29,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269229 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:31,153::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:31,158::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:31,171::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:31,172::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-238::DEBUG::2014-01-24 19:22:31,174::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-238::DEBUG::2014-01-24 19:22:31,179::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000440661 s, 4.6 MB/s\n'; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:31,179::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000440661 s, 4.6 MB/s'], size: 2048 >Thread-238::DEBUG::2014-01-24 19:22:31,180::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-238::DEBUG::2014-01-24 19:22:31,180::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-238::DEBUG::2014-01-24 19:22:31,181::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:31,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:31,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246913 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:33,161::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:33,166::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:33,372::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:33,373::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979'] >Thread-238::INFO::2014-01-24 19:22:33,373::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-238::INFO::2014-01-24 19:22:33,373::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-238::INFO::2014-01-24 19:22:33,373::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-238::DEBUG::2014-01-24 19:22:33,374::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1 >Thread-238::WARNING::2014-01-24 19:22:33,376::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists >Thread-120::DEBUG::2014-01-24 19:22:33,377::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-238::DEBUG::2014-01-24 19:22:33,383::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:33,473::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:33,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:33,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543345 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:33,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:33,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274285 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:35,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:35,174::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:35,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:35,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027052 s, 37.9 MB/s\n'; <rc> = 0 >Thread-243::INFO::2014-01-24 19:22:36,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-243::INFO::2014-01-24 19:22:36,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543345', 'lastCheck': '3.1', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:22:37,177::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:37,182::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:37,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:37,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265041 s, 38.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:39,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:39,190::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-01-24 19:22:39,317::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::WARNING::2014-01-24 19:22:39,320::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists >Thread-238::WARNING::2014-01-24 19:22:39,320::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists >Thread-238::INFO::2014-01-24 19:22:39,320::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-238::INFO::2014-01-24 19:22:39,321::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd >Thread-238::INFO::2014-01-24 19:22:39,322::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Dummy-233::DEBUG::2014-01-24 19:22:39,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:39,801::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270697 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:41,193::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:41,199::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:41,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:41,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274874 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:43,201::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:43,207::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:43,486::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:43,492::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664273 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:43,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-247::DEBUG::2014-01-24 19:22:43,887::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-247::INFO::2014-01-24 19:22:43,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-247::INFO::2014-01-24 19:22:43,888::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-248::DEBUG::2014-01-24 19:22:43,897::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-248::INFO::2014-01-24 19:22:43,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-248::INFO::2014-01-24 19:22:43,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:22:43,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289445 s, 35.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:45,210::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:45,215::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:45,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:45,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274034 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:47,218::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:47,223::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:47,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:48,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027211 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:49,226::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:49,231::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:50,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:50,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247897 s, 41.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:51,234::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:51,239::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-251::INFO::2014-01-24 19:22:51,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-251::INFO::2014-01-24 19:22:51,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664273', 'lastCheck': '8.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:22:52,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:52,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269084 s, 38.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:53,242::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:53,247::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:22:53,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:22:53,506::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643507 s, 6.4 MB/s\n'; <rc> = 0 >Thread-253::DEBUG::2014-01-24 19:22:53,933::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-253::INFO::2014-01-24 19:22:53,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-253::INFO::2014-01-24 19:22:53,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-254::DEBUG::2014-01-24 19:22:53,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-254::INFO::2014-01-24 19:22:53,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-254::INFO::2014-01-24 19:22:53,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:22:54,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:54,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277389 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:55,249::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:55,255::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:56,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:56,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242229 s, 42.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:57,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:57,263::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:22:58,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:22:58,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276842 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:22:59,265::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:22:59,270::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:00,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:00,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272544 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:01,273::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:01,278::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:02,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:02,480::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272904 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:03,281::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:03,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:03,511::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:03,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593579 s, 6.9 MB/s\n'; <rc> = 0 >Thread-259::DEBUG::2014-01-24 19:23:03,970::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-259::INFO::2014-01-24 19:23:03,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-259::INFO::2014-01-24 19:23:03,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-260::DEBUG::2014-01-24 19:23:03,979::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-260::INFO::2014-01-24 19:23:03,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-260::INFO::2014-01-24 19:23:03,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:23:04,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:04,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269734 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:05,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:05,294::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:06,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:06,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270842 s, 37.8 MB/s\n'; <rc> = 0 >Thread-261::INFO::2014-01-24 19:23:06,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-261::INFO::2014-01-24 19:23:06,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593579', 'lastCheck': '3.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:23:07,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:07,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:08,372::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-263::INFO::2014-01-24 19:23:08,373::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-263::DEBUG::2014-01-24 19:23:08,373::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-263::DEBUG::2014-01-24 19:23:08,373::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:08,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:08,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245903 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:09,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:09,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:10,440::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:10,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:10,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248931 s, 41.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:11,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:11,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:12,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:12,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271153 s, 37.8 MB/s\n'; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:13,247::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:13,250::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:13,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:13,336::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:13,520::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-266::DEBUG::2014-01-24 19:23:14,033::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-266::INFO::2014-01-24 19:23:14,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-266::INFO::2014-01-24 19:23:14,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-267::DEBUG::2014-01-24 19:23:14,061::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-267::INFO::2014-01-24 19:23:14,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-267::DEBUG::2014-01-24 19:23:14,062::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:14,789::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:14,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248551 s, 41.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:15,339::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:15,344::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:15,673::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:15,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:15,683::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619241 s, 6.6 MB/s\n'; <rc> = 0 >Thread-267::DEBUG::2014-01-24 19:23:16,223::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-267::INFO::2014-01-24 19:23:16,224::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:23:16,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:16,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239541 s, 42.7 MB/s\n'; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:17,312::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:17,347::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:17,353::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:17,716::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c54d5c01d2d /dev/mapper/3514f0c54d5c01d5f /dev/mapper/1cmg02 /dev/mapper/1cmg01' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:18,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:18,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272948 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:19,356::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:19,361::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:20,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:21,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245202 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:21,364::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:21,369::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-270::INFO::2014-01-24 19:23:22,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2014-01-24 19:23:22,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619241', 'lastCheck': '6.5', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:23:23,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:23,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248495 s, 41.2 MB/s\n'; <rc> = 0 >Thread-263::DEBUG::2014-01-24 19:23:23,109::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff\n Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff\n Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff\n Can\'t initialize physical volume "/dev/mapper/1cmg01" of volume group "a250db32-9b39-4533-8bc6-926d4ae17535" without -ff\n'; <rc> = 5 >Thread-263::DEBUG::2014-01-24 19:23:23,110::lvm::859::Storage.LVM::(testPVCreate) rc: 5, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff', ' Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff', ' Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff', ' Can\'t initialize physical volume "/dev/mapper/1cmg01" of volume group "a250db32-9b39-4533-8bc6-926d4ae17535" without -ff'], unusedDevs: set([]), usedDevs: set(['/dev/mapper/1cmg01', '/dev/mapper/3514f0c54d5c01d5f', '/dev/mapper/3514f0c54d5c01d2d', '/dev/mapper/1cmg02']) >Thread-263::INFO::2014-01-24 19:23:23,111::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ycYoMs-BCcs-Lkul-v2GF-V6Fy-Mbhr-LPcWAG', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'vEIhYh-t64d-rixc-zdaH-is3J-JAbn-m1ju94', 'serial': 'SXtremIO_XtremApp_92c6101061464169b0001027fc728e1b', 'GUID': '3514f0c54d5c01d2d', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ZO5XUI-KVa3-uvqI-K5ip-7zHm-xI9j-dNhA0P', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'TISsCt-PRFo-aQdO-dyEe-hZG2-M4d7-LOQYJJ', 'serial': 'SXtremIO_XtremApp_91838d02999c45b98b74def227cb4b50', 'GUID': '3514f0c54d5c01d5f', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '102005473280', 'fwrev': '0001', 'vgUUID': '2jFAnJ-0eb2-p5Jy-Qs3w-bOiW-oTPk-4o7Wcu', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'JjZ782-Z9MT-EaGF-ifdA-vAq5-5DBA-XAccgF', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg02', 'productID': 'VIRTUAL-DISK'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '91268055040', 'fwrev': '0001', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'productID': 'VIRTUAL-DISK'}]} >Thread-12::DEBUG::2014-01-24 19:23:23,372::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:23,377::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:25,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:25,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273659 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:25,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:25,385::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:25,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:25,694::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747024 s, 5.5 MB/s\n'; <rc> = 0 >Thread-273::DEBUG::2014-01-24 19:23:26,281::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-273::INFO::2014-01-24 19:23:26,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-273::INFO::2014-01-24 19:23:26,282::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-274::DEBUG::2014-01-24 19:23:26,309::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-274::INFO::2014-01-24 19:23:26,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-274::INFO::2014-01-24 19:23:26,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:23:27,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:27,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271909 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:27,388::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:27,393::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:29,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:29,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242708 s, 42.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:29,396::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:29,401::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:31,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:31,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02701 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:31,404::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:31,409::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:33,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:33,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272319 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:33,411::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:33,417::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:35,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:35,419::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:35,429::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:35,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457668 s, 22.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:35,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:35,704::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663414 s, 6.2 MB/s\n'; <rc> = 0 >Thread-278::DEBUG::2014-01-24 19:23:36,402::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-278::INFO::2014-01-24 19:23:36,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-278::INFO::2014-01-24 19:23:36,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-279::DEBUG::2014-01-24 19:23:36,409::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-279::INFO::2014-01-24 19:23:36,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-279::INFO::2014-01-24 19:23:36,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Thread-280::INFO::2014-01-24 19:23:37,400::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-280::INFO::2014-01-24 19:23:37,400::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663414', 'lastCheck': '1.7', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:23:37,441::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:37,446::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:37,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:37,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271602 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:39,449::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:39,454::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:39,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:39,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274433 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:41,457::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:41,462::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:41,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:41,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278595 s, 36.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:43,465::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:43,470::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:43,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:43,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024553 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:45,473::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:45,478::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:45,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:45,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665626 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:45,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:45,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02716 s, 37.7 MB/s\n'; <rc> = 0 >Thread-284::DEBUG::2014-01-24 19:23:46,506::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-284::INFO::2014-01-24 19:23:46,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-284::INFO::2014-01-24 19:23:46,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-285::DEBUG::2014-01-24 19:23:46,534::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-285::INFO::2014-01-24 19:23:46,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-285::INFO::2014-01-24 19:23:46,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Thread-12::DEBUG::2014-01-24 19:23:47,481::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:47,486::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:47,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:47,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027529 s, 37.2 MB/s\n'; <rc> = 0 >Thread-287::DEBUG::2014-01-24 19:23:48,093::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7099245d] >Thread-287::INFO::2014-01-24 19:23:48,094::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-287::DEBUG::2014-01-24 19:23:48,096::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None) >Thread-287::DEBUG::2014-01-24 19:23:48,219::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-287::DEBUG::2014-01-24 19:23:48,221::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a0e1b6de-824a-4543-8c86-adc34e634cee',) >Thread-287::DEBUG::2014-01-24 19:23:48,221::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-287::INFO::2014-01-24 19:23:48,221::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-288::DEBUG::2014-01-24 19:23:48,678::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3e3de33c] >Thread-288::INFO::2014-01-24 19:23:48,678::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b', 'port': ''}], options=None) >Thread-288::DEBUG::2014-01-24 19:23:48,680::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-288::DEBUG::2014-01-24 19:23:48,681::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a0e1b6de-824a-4543-8c86-adc34e634cee',) >Thread-288::DEBUG::2014-01-24 19:23:48,681::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-288::INFO::2014-01-24 19:23:48,681::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b'}]} >Thread-289::DEBUG::2014-01-24 19:23:48,727::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3e3de33c] >Thread-289::INFO::2014-01-24 19:23:48,727::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='619e3a48-8138-49c4-a8c6-4e218c033c95', domainName='export', typeSpecificArg='10.34.63.199:/cmg01', domClass=3, domVersion='0', options=None) >Thread-289::DEBUG::2014-01-24 19:23:48,727::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-289::DEBUG::2014-01-24 19:23:48,727::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:49,489::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:49,494::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:49,842::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:49,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024266 s, 42.2 MB/s\n'; <rc> = 0 >Thread-289::DEBUG::2014-01-24 19:23:50,830::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:51,497::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:51,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:51,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:51,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274553 s, 37.3 MB/s\n'; <rc> = 0 >Thread-291::INFO::2014-01-24 19:23:52,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-291::INFO::2014-01-24 19:23:52,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665626', 'lastCheck': '6.9', 'valid': True}} >Thread-289::DEBUG::2014-01-24 19:23:53,301::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-289::ERROR::2014-01-24 19:23:53,303::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 619e3a48-8138-49c4-a8c6-4e218c033c95 >Thread-289::ERROR::2014-01-24 19:23:53,303::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 619e3a48-8138-49c4-a8c6-4e218c033c95 >Thread-289::DEBUG::2014-01-24 19:23:53,304::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 619e3a48-8138-49c4-a8c6-4e218c033c95' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:53,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:53,513::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:53,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:54,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274988 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:23:55,517::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:55,522::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:55,719::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:56,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:23:56,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248273 s, 41.2 MB/s\n'; <rc> = 0 >Thread-289::DEBUG::2014-01-24 19:23:56,451::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "619e3a48-8138-49c4-a8c6-4e218c033c95" not found\n Skipping volume group 619e3a48-8138-49c4-a8c6-4e218c033c95\n'; <rc> = 5 >Thread-289::WARNING::2014-01-24 19:23:56,452::lvm::377::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "619e3a48-8138-49c4-a8c6-4e218c033c95" not found', ' Skipping volume group 619e3a48-8138-49c4-a8c6-4e218c033c95'] >Thread-289::ERROR::2014-01-24 19:23:56,537::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 619e3a48-8138-49c4-a8c6-4e218c033c95 not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('619e3a48-8138-49c4-a8c6-4e218c033c95',) >Thread-289::INFO::2014-01-24 19:23:56,537::nfsSD::69::Storage.StorageDomain::(create) sdUUID=619e3a48-8138-49c4-a8c6-4e218c033c95 domainName=export remotePath=10.34.63.199:/cmg01 domClass=3 >Thread-289::ERROR::2014-01-24 19:23:56,634::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain is not empty - requires cleaning: ('10.34.63.199:/cmg01',)", 'code': 361}} >Thread-295::DEBUG::2014-01-24 19:23:56,686::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-295::INFO::2014-01-24 19:23:56,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-295::INFO::2014-01-24 19:23:56,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-296::DEBUG::2014-01-24 19:23:56,713::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-296::INFO::2014-01-24 19:23:56,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-296::DEBUG::2014-01-24 19:23:56,715::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-297::DEBUG::2014-01-24 19:23:57,063::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [235f0344] >Thread-297::INFO::2014-01-24 19:23:57,064::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b', 'port': ''}], options=None) >Thread-297::DEBUG::2014-01-24 19:23:57,064::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None) >Thread-297::DEBUG::2014-01-24 19:23:57,091::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-297::DEBUG::2014-01-24 19:23:57,091::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:57,525::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:57,531::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:58,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:58,091::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:23:58,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:23:58,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000419461 s, 9.8 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:23:58,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396205 s, 25.8 MB/s\n'; <rc> = 0 >Thread-296::DEBUG::2014-01-24 19:23:59,092::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-296::INFO::2014-01-24 19:23:59,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Thread-297::DEBUG::2014-01-24 19:23:59,499::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:59,534::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:23:59,539::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:00,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:00,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276497 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:01,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:01,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-297::DEBUG::2014-01-24 19:24:02,136::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-297::INFO::2014-01-24 19:24:02,137::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b'}]} >Dummy-233::DEBUG::2014-01-24 19:24:02,221::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:02,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272615 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:03,550::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:03,556::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:04,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:04,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276728 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:05,559::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:05,564::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:06,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:06,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266756 s, 38.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:07,568::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:07,575::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-301::INFO::2014-01-24 19:24:07,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-301::INFO::2014-01-24 19:24:07,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419461', 'lastCheck': '9.7', 'valid': True}} >Thread-120::DEBUG::2014-01-24 19:24:08,118::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:08,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:08,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248043 s, 41.3 MB/s\n'; <rc> = 0 >Thread-303::DEBUG::2014-01-24 19:24:09,122::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-303::INFO::2014-01-24 19:24:09,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-303::INFO::2014-01-24 19:24:09,123::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-304::DEBUG::2014-01-24 19:24:09,129::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-304::INFO::2014-01-24 19:24:09,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-304::DEBUG::2014-01-24 19:24:09,130::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:09,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:09,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:10,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:10,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271103 s, 37.8 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:11,038::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:11,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:11,049::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710438 s, 5.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:11,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:11,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-304::DEBUG::2014-01-24 19:24:11,978::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-304::INFO::2014-01-24 19:24:11,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:24:12,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:12,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269194 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:13,597::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:13,603::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:14,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:14,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0240792 s, 42.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:15,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:15,610::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:16,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:16,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246655 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:17,615::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:17,622::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:18,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:18,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269518 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:19,624::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:19,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:20,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:20,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276404 s, 37.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:21,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:21,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628724 s, 6.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:21,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:21,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-309::DEBUG::2014-01-24 19:24:22,085::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-309::INFO::2014-01-24 19:24:22,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-309::INFO::2014-01-24 19:24:22,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-310::DEBUG::2014-01-24 19:24:22,091::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-310::INFO::2014-01-24 19:24:22,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-310::INFO::2014-01-24 19:24:22,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:24:22,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:22,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273878 s, 37.4 MB/s\n'; <rc> = 0 >Thread-311::INFO::2014-01-24 19:24:23,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-311::INFO::2014-01-24 19:24:23,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628724', 'lastCheck': '2.0', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:24:23,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:23,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:24,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:24,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277085 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:25,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:25,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:26,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:27,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272714 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:27,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:27,661::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:29,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:29,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024522 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:29,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:29,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:31,068::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:31,074::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582508 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:31,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:31,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266711 s, 38.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:31,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:31,678::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-315::DEBUG::2014-01-24 19:24:32,145::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-315::INFO::2014-01-24 19:24:32,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-315::INFO::2014-01-24 19:24:32,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-316::DEBUG::2014-01-24 19:24:32,154::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-316::INFO::2014-01-24 19:24:32,154::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-316::INFO::2014-01-24 19:24:32,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Dummy-233::DEBUG::2014-01-24 19:24:33,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:33,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272463 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:33,681::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:33,686::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-318::DEBUG::2014-01-24 19:24:35,035::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1faa93b] >Thread-318::INFO::2014-01-24 19:24:35,036::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None) >Thread-318::DEBUG::2014-01-24 19:24:35,037::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None) >Thread-318::DEBUG::2014-01-24 19:24:35,079::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-318::DEBUG::2014-01-24 19:24:35,080::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-318::DEBUG::2014-01-24 19:24:35,081::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-318::INFO::2014-01-24 19:24:35,081::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Dummy-233::DEBUG::2014-01-24 19:24:35,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-320::DEBUG::2014-01-24 19:24:35,261::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a] >Thread-320::INFO::2014-01-24 19:24:35,263::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None) >Thread-320::DEBUG::2014-01-24 19:24:35,273::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-320::DEBUG::2014-01-24 19:24:35,275::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-320::DEBUG::2014-01-24 19:24:35,276::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-320::INFO::2014-01-24 19:24:35,276::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]} >Dummy-233::DEBUG::2014-01-24 19:24:35,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032559 s, 31.5 MB/s\n'; <rc> = 0 >Thread-321::DEBUG::2014-01-24 19:24:35,290::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a] >Thread-321::INFO::2014-01-24 19:24:35,291::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', domainName='export', typeSpecificArg='10.34.63.199:/cmg01', domClass=3, domVersion='0', options=None) >Thread-321::DEBUG::2014-01-24 19:24:35,293::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-321::DEBUG::2014-01-24 19:24:35,293::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:35,689::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:35,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:37,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:37,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274163 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:37,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:37,703::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2014-01-24 19:24:38,061::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-322::INFO::2014-01-24 19:24:38,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-322::INFO::2014-01-24 19:24:38,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582508', 'lastCheck': '7.2', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:24:39,367::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:39,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272791 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:39,706::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:39,717::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:41,079::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:41,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056434 s, 7.3 MB/s\n'; <rc> = 0 >Thread-321::DEBUG::2014-01-24 19:24:41,234::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::ERROR::2014-01-24 19:24:41,235::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-321::ERROR::2014-01-24 19:24:41,235::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-321::DEBUG::2014-01-24 19:24:41,236::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 464da998-ebd2-46a1-bab0-1c02a21a165e' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:41,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:41,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267442 s, 38.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:41,720::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:41,725::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-325::DEBUG::2014-01-24 19:24:42,181::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-325::INFO::2014-01-24 19:24:42,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-325::INFO::2014-01-24 19:24:42,182::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-326::DEBUG::2014-01-24 19:24:42,188::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-326::INFO::2014-01-24 19:24:42,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-326::DEBUG::2014-01-24 19:24:42,189::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:43,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:43,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264913 s, 38.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:43,728::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:43,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2014-01-24 19:24:44,302::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' Volume group "464da998-ebd2-46a1-bab0-1c02a21a165e" not found\n Skipping volume group 464da998-ebd2-46a1-bab0-1c02a21a165e\n'; <rc> = 5 >Thread-321::WARNING::2014-01-24 19:24:44,303::lvm::377::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group "464da998-ebd2-46a1-bab0-1c02a21a165e" not found', ' Skipping volume group 464da998-ebd2-46a1-bab0-1c02a21a165e'] >Thread-321::ERROR::2014-01-24 19:24:44,305::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 464da998-ebd2-46a1-bab0-1c02a21a165e not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('464da998-ebd2-46a1-bab0-1c02a21a165e',) >Thread-321::INFO::2014-01-24 19:24:44,305::nfsSD::69::Storage.StorageDomain::(create) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e domainName=export remotePath=10.34.63.199:/cmg01 domClass=3 >Thread-321::DEBUG::2014-01-24 19:24:44,416::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-321::DEBUG::2014-01-24 19:24:44,419::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] >Thread-321::WARNING::2014-01-24 19:24:44,420::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd'] >Thread-321::DEBUG::2014-01-24 19:24:44,435::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-321::DEBUG::2014-01-24 19:24:44,436::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-321::DEBUG::2014-01-24 19:24:44,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-321::DEBUG::2014-01-24 19:24:44,442::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd'] >Thread-321::DEBUG::2014-01-24 19:24:44,444::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-321::DEBUG::2014-01-24 19:24:44,444::clusterlock::65::Storage.Misc.excCmd::(initLock) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/leases 0' (cwd /usr/libexec/vdsm) >Thread-321::DEBUG::2014-01-24 19:24:44,451::clusterlock::65::Storage.Misc.excCmd::(initLock) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2014-01-24 19:24:44,451::sd::424::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-321::DEBUG::2014-01-24 19:24:44,452::hsm::2592::Storage.HSM::(createStorageDomain) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-321::INFO::2014-01-24 19:24:44,453::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-329::DEBUG::2014-01-24 19:24:44,465::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a] >Thread-329::INFO::2014-01-24 19:24:44,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None) >Thread-329::INFO::2014-01-24 19:24:44,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '144349298688', 'disktotal': '144349954048', 'mdafree': 0}} >Thread-326::DEBUG::2014-01-24 19:24:44,495::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-326::INFO::2014-01-24 19:24:44,496::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}} >Thread-330::DEBUG::2014-01-24 19:24:44,731::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [6d96a476] >Thread-330::INFO::2014-01-24 19:24:44,731::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None) >Thread-330::DEBUG::2014-01-24 19:24:44,732::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None) >Thread-330::DEBUG::2014-01-24 19:24:44,762::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-330::DEBUG::2014-01-24 19:24:44,763::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:45,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:45,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278903 s, 36.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:45,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:45,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-330::DEBUG::2014-01-24 19:24:46,994::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:47,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:47,668::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270476 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:47,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:47,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-330::DEBUG::2014-01-24 19:24:49,651::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-330::INFO::2014-01-24 19:24:49,652::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]} >Dummy-233::DEBUG::2014-01-24 19:24:49,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:49,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273179 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:49,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:49,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-332::DEBUG::2014-01-24 19:24:49,989::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3a071170] >Thread-332::INFO::2014-01-24 19:24:49,990::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None) >Thread-332::DEBUG::2014-01-24 19:24:49,992::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None) >Thread-332::DEBUG::2014-01-24 19:24:50,024::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-332::DEBUG::2014-01-24 19:24:50,025::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('464da998-ebd2-46a1-bab0-1c02a21a165e',) >Thread-332::DEBUG::2014-01-24 19:24:50,026::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-332::INFO::2014-01-24 19:24:50,026::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]} >Thread-333::DEBUG::2014-01-24 19:24:50,037::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [14e41552] >Thread-333::INFO::2014-01-24 19:24:50,037::logUtils::44::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-333::INFO::2014-01-24 19:24:50,038::sp::928::Storage.StoragePool::(attachSD) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 >Thread-333::DEBUG::2014-01-24 19:24:50,040::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:51,088::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:51,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:51,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:51,772::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:51,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487903 s, 21.0 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:24:52,642::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:24:52,643::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-333::DEBUG::2014-01-24 19:24:52,643::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-335::INFO::2014-01-24 19:24:53,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-335::INFO::2014-01-24 19:24:53,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056434', 'lastCheck': '12.4', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:24:53,785::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:53,790::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:53,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:53,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277657 s, 36.9 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:54,242::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:24:54,246::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:24:54,252::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615814 s, 6.7 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:24:55,374::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:55,793::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:55,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:24:55,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:24:55,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272337 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:57,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:57,808::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:24:57,935::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:24:57,939::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-333::DEBUG::2014-01-24 19:24:57,941::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-333::DEBUG::2014-01-24 19:24:57,945::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd'] >Dummy-233::DEBUG::2014-01-24 19:24:57,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-333::DEBUG::2014-01-24 19:24:57,952::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-333::INFO::2014-01-24 19:24:57,953::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered >Thread-333::INFO::2014-01-24 19:24:57,953::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered >Thread-333::DEBUG::2014-01-24 19:24:57,954::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 464da998-ebd2-46a1-bab0-1c02a21a165e 1 5 /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm) >Dummy-233::DEBUG::2014-01-24 19:24:58,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278754 s, 36.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:24:59,812::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:24:59,818::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:00,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:00,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269393 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:01,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:01,829::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:02,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:02,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273165 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:03,832::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:03,838::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:04,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:04,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275761 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:25:04,258::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:05,841::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:05,846::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:06,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:06,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275222 s, 37.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:25:06,600::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:25:06,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:06,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000460607 s, 8.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:07,849::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:07,855::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:08,259::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:08,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271382 s, 37.7 MB/s\n'; <rc> = 0 >Thread-342::INFO::2014-01-24 19:25:08,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-342::INFO::2014-01-24 19:25:08,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460607', 'lastCheck': '2.1', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:25:09,862::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:09,867::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:10,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:10,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275293 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:11,870::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:11,875::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:12,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:12,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269667 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:13,878::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:13,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:14,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:14,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274525 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:15,886::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:15,891::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:16,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:16,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275829 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:25:16,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:16,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061967 s, 6.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:17,894::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:17,900::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:17,982::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd'] >Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83a3e5dc11dd4cce15e37a7d8e35b7b6f70f1c39'] >Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395'] >Thread-333::DEBUG::2014-01-24 19:25:17,994::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:18,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:18,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270886 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:19,903::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:19,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:20,160::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:20,161::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active --deltag MDT__SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979 --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Attached --addtag MDT__SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-333::DEBUG::2014-01-24 19:25:20,359::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:20,360::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-333::INFO::2014-01-24 19:25:20,360::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-333::DEBUG::2014-01-24 19:25:20,360::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh 464da998-ebd2-46a1-bab0-1c02a21a165e' (cwd /usr/libexec/vdsm) >Dummy-233::DEBUG::2014-01-24 19:25:20,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:20,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277698 s, 36.9 MB/s\n'; <rc> = 0 >Thread-333::DEBUG::2014-01-24 19:25:21,379::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0 >Thread-333::INFO::2014-01-24 19:25:21,380::logUtils::47::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None >Thread-348::DEBUG::2014-01-24 19:25:21,390::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [22979cf5] >Thread-348::INFO::2014-01-24 19:25:21,391::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', size='10737418240', volFormat=5, preallocate=1, diskType=2, volUUID='e695cd65-e815-4ace-956d-7e24736a8a43', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-348::INFO::2014-01-24 19:25:21,436::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:21,500::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-349::DEBUG::2014-01-24 19:25:21,508::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-349::INFO::2014-01-24 19:25:21,508::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-349::INFO::2014-01-24 19:25:21,509::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-350::DEBUG::2014-01-24 19:25:21,517::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-350::INFO::2014-01-24 19:25:21,517::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-350::DEBUG::2014-01-24 19:25:21,518::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-351::DEBUG::2014-01-24 19:25:21,567::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [2ef684a] >Thread-351::INFO::2014-01-24 19:25:21,568::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None) >Thread-351::DEBUG::2014-01-24 19:25:21,571::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01 >Thread-351::DEBUG::2014-01-24 19:25:21,571::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('464da998-ebd2-46a1-bab0-1c02a21a165e',) >Thread-351::DEBUG::2014-01-24 19:25:21,572::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain} >Thread-351::INFO::2014-01-24 19:25:21,572::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]} >Thread-12::DEBUG::2014-01-24 19:25:21,911::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:21,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:22,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:22,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245944 s, 41.6 MB/s\n'; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,837::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,841::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,841::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 529697b6-0f60-43c8-8fe1-ae01cfc536eb does not exist in domain a250db32-9b39-4533-8bc6-926d4ae17535 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:23,841::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb for image's volumes >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:23,879::volume::443::Storage.Volume::(create) Creating volume e695cd65-e815-4ace-956d-7e24736a8a43 >Thread-12::DEBUG::2014-01-24 19:25:23,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-350::DEBUG::2014-01-24 19:25:23,927::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-350::INFO::2014-01-24 19:25:23,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}} >Thread-12::DEBUG::2014-01-24 19:25:23,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,937::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 10240m --addtag OVIRT_VOL_INITIALIZING --name e695cd65-e815-4ace-956d-7e24736a8a43 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-352::DEBUG::2014-01-24 19:25:24,004::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4cb92eb6] >Thread-352::INFO::2014-01-24 19:25:24,004::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-352::INFO::2014-01-24 19:25:24,005::sp::1060::Storage.StoragePool::(activateSD) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 >Thread-352::DEBUG::2014-01-24 19:25:24,006::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-352::DEBUG::2014-01-24 19:25:24,006::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-353::INFO::2014-01-24 19:25:24,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-353::INFO::2014-01-24 19:25:24,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061967', 'lastCheck': '7.4', 'valid': True}} >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:24,076::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::WARNING::2014-01-24 19:25:24,077::utils::128::root::(rmFile) File: /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 already removed >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:24,077::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 with size = 20971520 sectors >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:24,078::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:24,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:24,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027044 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:25,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:25,959::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-352::DEBUG::2014-01-24 19:25:26,232::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,383::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::WARNING::2014-01-24 19:25:26,388::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG a250db32-9b39-4533-8bc6-926d4ae17535 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_529697b6-0f60-43c8-8fe1-ae01cfc536eb a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:26,626::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:26,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:26,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281671 s, 36.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:27,962::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:27,968::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:28,643::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-352::DEBUG::2014-01-24 19:25:28,851::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:28,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:28,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273364 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:29,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:29,976::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:25:30,738::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:30,749::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:30,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:30,776::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520921 s, 7.9 MB/s\n'; <rc> = 0 >Thread-352::DEBUG::2014-01-24 19:25:30,781::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-352::DEBUG::2014-01-24 19:25:30,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:25:30,785::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-352::DEBUG::2014-01-24 19:25:30,790::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83a3e5dc11dd4cce15e37a7d8e35b7b6f70f1c39'] >Thread-352::DEBUG::2014-01-24 19:25:30,791::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-352::INFO::2014-01-24 19:25:30,792::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered >Thread-352::INFO::2014-01-24 19:25:30,792::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered >Thread-352::INFO::2014-01-24 19:25:30,792::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-352::DEBUG::2014-01-24 19:25:30,794::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-352::DEBUG::2014-01-24 19:25:30,794::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc'] >Thread-352::DEBUG::2014-01-24 19:25:30,798::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-352::DEBUG::2014-01-24 19:25:30,800::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/master/vms >Thread-352::DEBUG::2014-01-24 19:25:30,801::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/master/tasks >Thread-352::DEBUG::2014-01-24 19:25:30,802::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-352::DEBUG::2014-01-24 19:25:30,802::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-352::DEBUG::2014-01-24 19:25:30,803::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6'] >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:30,880::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:30,941::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:30,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277691 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:31,979::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:31,984::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:33,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:33,013::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:33,018::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-352::DEBUG::2014-01-24 19:25:33,025::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:33,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391021 s, 26.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:33,986::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:33,992::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:35,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:35,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248467 s, 41.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:35,995::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:36,000::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:37,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:37,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271076 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:38,003::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:38,008::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:39,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-360::INFO::2014-01-24 19:25:39,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-360::INFO::2014-01-24 19:25:39,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061967', 'lastCheck': '22.6', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:25:39,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502905 s, 20.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:40,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:40,019::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:41,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:41,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245016 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:42,022::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:42,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,137::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,141::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-352::DEBUG::2014-01-24 19:25:42,229::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-352::DEBUG::2014-01-24 19:25:42,231::lvm::295::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Attached --deltag MDT__SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395 --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Active --addtag MDT__SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-352::DEBUG::2014-01-24 19:25:42,404::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-352::DEBUG::2014-01-24 19:25:42,405::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,406::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=e695cd65-e815-4ace-956d-7e24736a8a43 sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535, metaId=('a250db32-9b39-4533-8bc6-926d4ae17535', 4) >Thread-352::INFO::2014-01-24 19:25:42,407::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-352::DEBUG::2014-01-24 19:25:42,408::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `464da998-ebd2-46a1-bab0-1c02a21a165e` >Thread-363::DEBUG::2014-01-24 19:25:42,408::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-352::INFO::2014-01-24 19:25:42,411::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-364::DEBUG::2014-01-24 19:25:42,439::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-363::DEBUG::2014-01-24 19:25:42,440::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-364::INFO::2014-01-24 19:25:42,445::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-364::INFO::2014-01-24 19:25:42,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-363::DEBUG::2014-01-24 19:25:42,449::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.0002816 s, 1.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:25:42,450::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 464da998-ebd2-46a1-bab0-1c02a21a165e changed its status to Valid >Thread-365::DEBUG::2014-01-24 19:25:42,450::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-365::DEBUG::2014-01-24 19:25:42,450::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-365::DEBUG::2014-01-24 19:25:42,451::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain` >Thread-365::DEBUG::2014-01-24 19:25:42,451::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-366::INFO::2014-01-24 19:25:42,456::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-368::DEBUG::2014-01-24 19:25:42,460::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4cb92eb6] >Thread-368::INFO::2014-01-24 19:25:42,461::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None) >Thread-368::INFO::2014-01-24 19:25:42,465::hsm::865::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM) >Thread-368::INFO::2014-01-24 19:25:42,466::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None >Thread-369::DEBUG::2014-01-24 19:25:42,471::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-369::INFO::2014-01-24 19:25:42,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-369::DEBUG::2014-01-24 19:25:42,475::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:43,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:43,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272945 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:44,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:44,039::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:45,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:45,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274137 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:46,042::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:46,047::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-369::DEBUG::2014-01-24 19:25:46,603::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-369::INFO::2014-01-24 19:25:46,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '75967234048', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-371::DEBUG::2014-01-24 19:25:46,681::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-371::INFO::2014-01-24 19:25:46,681::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-371::INFO::2014-01-24 19:25:46,681::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3250cadc-e2ca-4426-b4c4-3dd3f40b23f3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3250cadc-e2ca-4426-b4c4-3dd3f40b23f3'}}} >Thread-372::DEBUG::2014-01-24 19:25:46,794::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [22979cf5] >Thread-372::INFO::2014-01-24 19:25:46,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', volUUID='e695cd65-e815-4ace-956d-7e24736a8a43', options=None) >Thread-372::INFO::2014-01-24 19:25:46,795::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb volUUID = e695cd65-e815-4ace-956d-7e24736a8a43 >Thread-372::DEBUG::2014-01-24 19:25:46,797::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-372::DEBUG::2014-01-24 19:25:46,803::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000553637 s, 925 kB/s\n'; <rc> = 0 >Thread-372::DEBUG::2014-01-24 19:25:46,803::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000553637 s, 925 kB/s'], size: 512 >Thread-372::DEBUG::2014-01-24 19:25:46,805::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-372::DEBUG::2014-01-24 19:25:46,811::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000619979 s, 826 kB/s\n'; <rc> = 0 >Thread-372::DEBUG::2014-01-24 19:25:46,811::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000619979 s, 826 kB/s'], size: 512 >Thread-372::INFO::2014-01-24 19:25:46,811::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '529697b6-0f60-43c8-8fe1-ae01cfc536eb', 'ctime': '1390587942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587942', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e695cd65-e815-4ace-956d-7e24736a8a43', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-372::INFO::2014-01-24 19:25:46,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '529697b6-0f60-43c8-8fe1-ae01cfc536eb', 'ctime': '1390587942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587942', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e695cd65-e815-4ace-956d-7e24736a8a43', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-373::DEBUG::2014-01-24 19:25:46,942::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-373::INFO::2014-01-24 19:25:46,942::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3250cadc-e2ca-4426-b4c4-3dd3f40b23f3', spUUID=None, options=None) >Thread-373::INFO::2014-01-24 19:25:46,943::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Dummy-233::DEBUG::2014-01-24 19:25:47,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:47,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277813 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:48,050::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:48,056::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:49,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:49,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272038 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:50,059::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:50,064::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:51,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:51,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274774 s, 37.3 MB/s\n'; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,017::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18bad2f6] >Thread-376::INFO::2014-01-24 19:25:52,017::logUtils::44::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmUUID='', srcImgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', srcVolUUID='e695cd65-e815-4ace-956d-7e24736a8a43', dstImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', dstVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', description='Active VM', dstSdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', volType=6, volFormat=5, preallocate=1, postZero='false', force='false') >Thread-376::DEBUG::2014-01-24 19:25:52,018::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:52,067::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:52,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,114::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,117::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-376::INFO::2014-01-24 19:25:52,117::image::285::Storage.Image::(isLegal) image 529697b6-0f60-43c8-8fe1-ae01cfc536eb in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist ['e695cd65-e815-4ace-956d-7e24736a8a43'] >Thread-376::DEBUG::2014-01-24 19:25:52,120::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-376::DEBUG::2014-01-24 19:25:52,125::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000447091 s, 1.1 MB/s\n'; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,126::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000447091 s, 1.1 MB/s'], size: 512 >Thread-376::DEBUG::2014-01-24 19:25:52,128::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-376::DEBUG::2014-01-24 19:25:52,133::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000482628 s, 1.1 MB/s\n'; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,133::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000482628 s, 1.1 MB/s'], size: 512 >Thread-376::DEBUG::2014-01-24 19:25:52,134::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-376::DEBUG::2014-01-24 19:25:52,228::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,233::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-376::DEBUG::2014-01-24 19:25:52,235::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-376::DEBUG::2014-01-24 19:25:52,241::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000550177 s, 931 kB/s\n'; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,241::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000550177 s, 931 kB/s'], size: 512 >Thread-376::DEBUG::2014-01-24 19:25:52,243::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-376::DEBUG::2014-01-24 19:25:52,249::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00053744 s, 953 kB/s\n'; <rc> = 0 >Thread-376::DEBUG::2014-01-24 19:25:52,249::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00053744 s, 953 kB/s'], size: 512 >Thread-376::INFO::2014-01-24 19:25:52,249::image::215::Storage.Image::(getChain) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb chain=[<storage.blockVolume.BlockVolume object at 0x7f88a03a9a90>] >Thread-376::INFO::2014-01-24 19:25:52,282::logUtils::47::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,353::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:52,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:25:52,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000353308 s, 11.6 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,446::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,450::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,466::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,475::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000417735 s, 1.2 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,476::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000417735 s, 1.2 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,492::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:25:52,503::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,508::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000446263 s, 1.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,510::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000446263 s, 1.1 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,511::image::215::Storage.Image::(getChain) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb chain=[<storage.blockVolume.BlockVolume object at 0x7f88a0325c90>] >Thread-363::DEBUG::2014-01-24 19:25:52,517::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000272964 s, 1.3 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,521::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,615::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,618::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,618::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image df30ebf7-0d71-40b0-a33e-07170bdead7d does not exist in domain a250db32-9b39-4533-8bc6-926d4ae17535 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,619::image::645::Storage.Image::(copyCollapsed) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 vmUUID= srcImgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb srcVolUUID=e695cd65-e815-4ace-956d-7e24736a8a43 dstImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d dstVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstSdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 volType=6 volFormat=RAW preallocate=PREALLOCATED force=False postZero=False >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,621::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,627::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000560452 s, 914 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,627::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000560452 s, 914 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,629::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,635::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526872 s, 972 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,635::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526872 s, 972 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,637::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,642::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0005531 s, 926 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,643::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0005531 s, 926 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,645::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,650::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000505854 s, 1.0 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,650::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000505854 s, 1.0 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,653::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,659::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000506787 s, 1.0 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,659::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000506787 s, 1.0 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,663::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,669::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000604137 s, 847 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,669::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000604137 s, 847 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,669::image::695::Storage.Image::(copyCollapsed) copy source a250db32-9b39-4533-8bc6-926d4ae17535:529697b6-0f60-43c8-8fe1-ae01cfc536eb:e695cd65-e815-4ace-956d-7e24736a8a43 vol size 20971520 destination a250db32-9b39-4533-8bc6-926d4ae17535:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b apparentsize 20971520 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,670::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,764::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,768::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,769::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist [] >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,769::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d for image's volumes >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,811::volume::443::Storage.Volume::(create) Creating volume 228f2939-3615-4733-ae3c-fc37390a2d0b >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,868::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 10m --addtag OVIRT_VOL_INITIALIZING --name 228f2939-3615-4733-ae3c-fc37390a2d0b a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:53,005::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::WARNING::2014-01-24 19:25:53,006::utils::128::root::(rmFile) File: /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b already removed >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:53,007::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b with size = 20480 sectors >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:53,008::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:53,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:53,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261552 s, 39.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:54,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:54,081::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-377::INFO::2014-01-24 19:25:54,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-377::INFO::2014-01-24 19:25:54,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353308', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272964', 'lastCheck': '1.9', 'valid': True}} >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,255::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,260::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::WARNING::2014-01-24 19:25:55,260::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,261::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 5 in VG a250db32-9b39-4533-8bc6-926d4ae17535 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,261::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_df30ebf7-0d71-40b0-a33e-07170bdead7d --addtag MD_5 a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:55,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:55,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243256 s, 42.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:56,085::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:56,090::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-379::DEBUG::2014-01-24 19:25:56,683::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-379::INFO::2014-01-24 19:25:56,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-379::INFO::2014-01-24 19:25:56,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-380::DEBUG::2014-01-24 19:25:56,691::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-380::INFO::2014-01-24 19:25:56,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-380::DEBUG::2014-01-24 19:25:56,692::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:57,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:57,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272219 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:25:58,093::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:25:58,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:58,727::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:25:59,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:25:59,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276633 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:00,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:00,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-380::DEBUG::2014-01-24 19:26:00,970::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-380::INFO::2014-01-24 19:26:00,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '75967234048', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:00,978::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >Thread-383::DEBUG::2014-01-24 19:26:01,029::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-383::INFO::2014-01-24 19:26:01,029::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-383::INFO::2014-01-24 19:26:01,029::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,080::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,081::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,175::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,180::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:01,180::volume::485::Storage.Volume::(create) The requested size for volume 228f2939-3615-4733-ae3c-fc37390a2d0b doesn't match the granularity on domain a250db32-9b39-4533-8bc6-926d4ae17535, updating the volume size from 20480 to 262144 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,276::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=228f2939-3615-4733-ae3c-fc37390a2d0b sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535, metaId=('a250db32-9b39-4533-8bc6-926d4ae17535', 5) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:01,324::blockVolume::268::Storage.Volume::(extend) Request to extend LV 228f2939-3615-4733-ae3c-fc37390a2d0b of image df30ebf7-0d71-40b0-a33e-07170bdead7d in VG a250db32-9b39-4533-8bc6-926d4ae17535 with size = 20971520 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,324::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 10240m a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,428::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,429::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:01,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:01,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245516 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:02,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:02,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:02,446::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:02,528::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:02,534::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000319537 s, 1.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,827::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,831::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,833::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,839::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000483937 s, 1.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,840::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000483937 s, 1.1 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:03,842::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,844::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,850::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000501642 s, 1.0 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,850::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000501642 s, 1.0 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,851::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:03,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:04,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273721 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:04,119::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:04,125::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:04,660::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:04,663::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:04,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000397423 s, 10.3 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:06,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:06,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242733 s, 42.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:06,128::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:06,133::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,147::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,150::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,244::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,248::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,251::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,256::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000454155 s, 1.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,257::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000454155 s, 1.1 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:06,257::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,259::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,264::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000565785 s, 905 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,265::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000565785 s, 905 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,267::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,272::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000518569 s, 987 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,272::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000518569 s, 987 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,273::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,462::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,463::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,557::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,561::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,564::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,569::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000471775 s, 1.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,570::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000471775 s, 1.1 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,572::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,577::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000572383 s, 895 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,577::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000572383 s, 895 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,582::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000332106 s, 1.5 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000332106 s, 1.5 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 (raw) to /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) START >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,591::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 of=/rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10240 oflag=direct' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:08,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:08,136::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:08,153::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:08,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504783 s, 20.3 MB/s\n'; <rc> = 0 >Thread-386::INFO::2014-01-24 19:26:09,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-386::INFO::2014-01-24 19:26:09,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397423', 'lastCheck': '5.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319537', 'lastCheck': '7.2', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:26:10,167::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:10,173::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:10,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:10,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293175 s, 34.9 MB/s\n'; <rc> = 0 >Thread-388::DEBUG::2014-01-24 19:26:11,032::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-388::INFO::2014-01-24 19:26:11,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-388::INFO::2014-01-24 19:26:11,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-389::DEBUG::2014-01-24 19:26:11,076::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-389::INFO::2014-01-24 19:26:11,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-389::INFO::2014-01-24 19:26:11,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-390::DEBUG::2014-01-24 19:26:11,140::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-390::INFO::2014-01-24 19:26:11,140::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-390::INFO::2014-01-24 19:26:11,140::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:26:12,176::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:12,181::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:12,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:12,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273072 s, 37.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:26:12,541::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:12,551::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00131444 s, 260 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:14,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:14,190::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:14,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:14,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303778 s, 33.7 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:14,673::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-120::DEBUG::2014-01-24 19:26:14,673::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:26:14,676::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:14,688::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00687008 s, 298 kB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:14,688::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00687008 s, 298 kB/s'], size: 2048 >Thread-120::DEBUG::2014-01-24 19:26:14,688::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-120::DEBUG::2014-01-24 19:26:14,688::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:26:14,689::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:16,193::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:16,199::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:16,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:16,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384343 s, 26.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:17,222::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:17,223::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6'] >Thread-120::INFO::2014-01-24 19:26:17,223::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-120::INFO::2014-01-24 19:26:17,223::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-120::INFO::2014-01-24 19:26:17,224::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-120::DEBUG::2014-01-24 19:26:17,224::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:17,393::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:17,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:17,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00452359 s, 905 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:18,202::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:18,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:18,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:18,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338103 s, 30.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:20,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:20,216::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:20,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:20,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337204 s, 30.4 MB/s\n'; <rc> = 0 >Thread-394::DEBUG::2014-01-24 19:26:21,145::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-394::INFO::2014-01-24 19:26:21,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-394::INFO::2014-01-24 19:26:21,146::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-395::DEBUG::2014-01-24 19:26:21,154::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-395::INFO::2014-01-24 19:26:21,155::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-395::INFO::2014-01-24 19:26:21,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-396::DEBUG::2014-01-24 19:26:21,196::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-396::INFO::2014-01-24 19:26:21,196::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-396::INFO::2014-01-24 19:26:21,196::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:26:22,219::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:22,225::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:26:22,559::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:22,568::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00188342 s, 182 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:22,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:22,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338749 s, 30.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:24,228::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:24,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:24,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:24,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286743 s, 35.7 MB/s\n'; <rc> = 0 >Thread-398::INFO::2014-01-24 19:26:24,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-398::INFO::2014-01-24 19:26:24,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00452359', 'lastCheck': '7.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00188342', 'lastCheck': '2.3', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:26:26,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:26,242::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:26,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:26,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269756 s, 38.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:27,412::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:27,422::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0037507 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:28,246::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:28,252::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:28,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:28,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318698 s, 32.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:30,255::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:30,260::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:30,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:30,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266304 s, 38.5 MB/s\n'; <rc> = 0 >Thread-402::DEBUG::2014-01-24 19:26:31,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-402::INFO::2014-01-24 19:26:31,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-402::INFO::2014-01-24 19:26:31,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-403::DEBUG::2014-01-24 19:26:31,216::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-403::INFO::2014-01-24 19:26:31,216::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-403::INFO::2014-01-24 19:26:31,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:26:32,263::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:32,268::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:26:32,575::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:32,581::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00032592 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:32,944::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:32,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265901 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:34,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:34,277::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-405::DEBUG::2014-01-24 19:26:34,985::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-405::INFO::2014-01-24 19:26:34,986::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-405::INFO::2014-01-24 19:26:34,986::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:26:35,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:35,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251908 s, 40.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:36,280::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:36,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:37,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:37,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315473 s, 32.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:37,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:37,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0036599 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:38,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:38,294::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:39,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:39,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308067 s, 33.2 MB/s\n'; <rc> = 0 >Thread-407::INFO::2014-01-24 19:26:40,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-407::INFO::2014-01-24 19:26:40,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036599', 'lastCheck': '2.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032592', 'lastCheck': '7.6', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:26:40,297::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:40,302::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:41,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:41,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282556 s, 36.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:42,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:42,311::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:26:42,589::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:42,596::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00067999 s, 503 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:43,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:43,336::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365287 s, 28.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:44,314::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:44,319::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-410::DEBUG::2014-01-24 19:26:44,984::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-410::INFO::2014-01-24 19:26:44,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-410::INFO::2014-01-24 19:26:44,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-411::DEBUG::2014-01-24 19:26:44,993::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-411::INFO::2014-01-24 19:26:44,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-411::INFO::2014-01-24 19:26:44,994::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:26:45,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:45,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264005 s, 38.8 MB/s\n'; <rc> = 0 >Thread-412::DEBUG::2014-01-24 19:26:45,784::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-412::INFO::2014-01-24 19:26:45,785::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-412::INFO::2014-01-24 19:26:45,785::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:26:46,323::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:46,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:47,406::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:47,458::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:47,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00351482 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:47,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256189 s, 40.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:48,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:48,339::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:49,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:49,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336612 s, 30.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:50,342::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:50,348::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:51,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:51,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266521 s, 38.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:52,351::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:52,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:26:52,604::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:26:52,613::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00159454 s, 214 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:53,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:53,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297623 s, 34.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:54,360::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:54,365::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-416::INFO::2014-01-24 19:26:55,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-416::INFO::2014-01-24 19:26:55,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00351482', 'lastCheck': '7.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00159454', 'lastCheck': '2.8', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:26:55,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:55,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257701 s, 39.7 MB/s\n'; <rc> = 0 >Thread-418::DEBUG::2014-01-24 19:26:55,796::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-418::INFO::2014-01-24 19:26:55,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-418::INFO::2014-01-24 19:26:55,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-419::DEBUG::2014-01-24 19:26:55,808::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-419::INFO::2014-01-24 19:26:55,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-419::INFO::2014-01-24 19:26:55,809::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:26:56,368::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:56,373::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:26:57,498::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:26:57,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0059804 s, 685 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:26:57,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:57,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265587 s, 38.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:26:58,376::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:26:58,382::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-420::DEBUG::2014-01-24 19:26:58,778::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-420::INFO::2014-01-24 19:26:58,779::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-420::INFO::2014-01-24 19:26:58,779::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:26:59,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:26:59,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255146 s, 40.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:00,385::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:00,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:01,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:01,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238531 s, 42.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:02,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:02,399::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:02,622::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:02,628::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000277729 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:03,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:04,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027973 s, 36.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:04,403::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:04,408::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:06,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:06,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027783 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:06,411::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:06,417::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:07,515::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:07,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0046843 s, 874 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:08,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:08,148::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312819 s, 32.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:08,420::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:08,426::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-424::DEBUG::2014-01-24 19:27:08,708::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-424::INFO::2014-01-24 19:27:08,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-424::INFO::2014-01-24 19:27:08,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-425::DEBUG::2014-01-24 19:27:08,729::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-425::INFO::2014-01-24 19:27:08,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-425::INFO::2014-01-24 19:27:08,733::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-426::DEBUG::2014-01-24 19:27:08,898::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-426::INFO::2014-01-24 19:27:08,899::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-426::INFO::2014-01-24 19:27:08,899::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:27:10,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:10,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317985 s, 32.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:10,429::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:10,434::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:12,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:12,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031173 s, 32.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:12,437::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:12,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:12,636::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:12,642::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033051 s, 1.0 MB/s\n'; <rc> = 0 >Thread-428::INFO::2014-01-24 19:27:13,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-428::INFO::2014-01-24 19:27:13,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0046843', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033051', 'lastCheck': '1.1', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:27:14,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:14,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287368 s, 35.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:14,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:14,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:16,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:16,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268718 s, 38.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:16,454::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:16,460::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:17,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:17,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545342 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:18,420::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:18,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:18,474::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:18,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262986 s, 38.9 MB/s\n'; <rc> = 0 >Thread-431::DEBUG::2014-01-24 19:27:18,902::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-431::INFO::2014-01-24 19:27:18,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-431::INFO::2014-01-24 19:27:18,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-432::DEBUG::2014-01-24 19:27:18,914::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-432::INFO::2014-01-24 19:27:18,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-432::INFO::2014-01-24 19:27:18,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-433::DEBUG::2014-01-24 19:27:19,040::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-433::INFO::2014-01-24 19:27:19,040::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-433::INFO::2014-01-24 19:27:19,040::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:27:20,485::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:20,490::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:20,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:20,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287121 s, 35.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:22,493::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:22,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:22,566::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:22,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325701 s, 31.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:22,650::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:22,656::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000297412 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:24,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:24,508::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:24,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:24,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277863 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:26,511::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:26,516::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:26,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:26,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304439 s, 33.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:27,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:27,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360993 s, 11.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:28,519::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:28,525::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:28,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:28,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286403 s, 35.8 MB/s\n'; <rc> = 0 >Thread-437::DEBUG::2014-01-24 19:27:29,022::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-437::INFO::2014-01-24 19:27:29,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-437::INFO::2014-01-24 19:27:29,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-438::DEBUG::2014-01-24 19:27:29,028::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-438::INFO::2014-01-24 19:27:29,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-438::INFO::2014-01-24 19:27:29,030::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-439::DEBUG::2014-01-24 19:27:29,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-439::INFO::2014-01-24 19:27:29,134::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-439::INFO::2014-01-24 19:27:29,134::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:27:30,528::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:30,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-440::INFO::2014-01-24 19:27:30,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-440::INFO::2014-01-24 19:27:30,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360993', 'lastCheck': '3.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297412', 'lastCheck': '7.9', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:27:30,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:30,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029723 s, 34.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:32,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:32,542::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:32,664::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:32,670::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000321766 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:32,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:32,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344382 s, 29.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:34,545::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:34,551::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:34,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:35,024::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027562 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:36,554::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:36,559::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:37,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:37,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264925 s, 38.7 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:37,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:37,560::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557722 s, 7.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:38,562::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:38,567::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:39,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-444::DEBUG::2014-01-24 19:27:39,135::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-444::INFO::2014-01-24 19:27:39,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-444::INFO::2014-01-24 19:27:39,138::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-445::DEBUG::2014-01-24 19:27:39,148::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-445::INFO::2014-01-24 19:27:39,150::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-445::INFO::2014-01-24 19:27:39,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:27:39,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026637 s, 38.4 MB/s\n'; <rc> = 0 >Thread-446::DEBUG::2014-01-24 19:27:39,594::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-446::INFO::2014-01-24 19:27:39,594::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-446::INFO::2014-01-24 19:27:39,595::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:27:40,570::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:40,576::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:41,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:41,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0240604 s, 42.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:42,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:42,585::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:42,678::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:42,685::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000322848 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:43,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:43,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306672 s, 33.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:44,588::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:44,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:45,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:45,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267539 s, 38.3 MB/s\n'; <rc> = 0 >Thread-449::INFO::2014-01-24 19:27:45,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-449::INFO::2014-01-24 19:27:45,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557722', 'lastCheck': '8.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322848', 'lastCheck': '3.1', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:27:46,596::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:46,602::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:47,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:47,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298263 s, 34.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:47,565::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:47,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00654988 s, 625 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:48,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:48,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:49,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:49,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309393 s, 33.1 MB/s\n'; <rc> = 0 >Thread-452::DEBUG::2014-01-24 19:27:49,567::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-452::INFO::2014-01-24 19:27:49,568::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-452::INFO::2014-01-24 19:27:49,568::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-453::DEBUG::2014-01-24 19:27:49,576::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-453::INFO::2014-01-24 19:27:49,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-453::INFO::2014-01-24 19:27:49,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-454::DEBUG::2014-01-24 19:27:49,670::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-454::INFO::2014-01-24 19:27:49,670::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-454::INFO::2014-01-24 19:27:49,671::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:27:50,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:50,620::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:51,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:51,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267466 s, 38.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:52,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:52,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:27:52,693::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:27:52,699::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000290638 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:53,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:53,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312298 s, 32.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:54,631::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:54,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:55,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:55,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282068 s, 36.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:56,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:56,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:27:57,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:27:57,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000493083 s, 8.3 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:27:57,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:57,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266415 s, 38.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:27:58,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:27:58,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-458::DEBUG::2014-01-24 19:27:59,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-458::INFO::2014-01-24 19:27:59,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-458::INFO::2014-01-24 19:27:59,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-459::DEBUG::2014-01-24 19:27:59,669::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-459::INFO::2014-01-24 19:27:59,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-459::INFO::2014-01-24 19:27:59,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:27:59,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:27:59,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249585 s, 41.0 MB/s\n'; <rc> = 0 >Thread-460::DEBUG::2014-01-24 19:28:00,046::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-460::INFO::2014-01-24 19:28:00,046::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-460::INFO::2014-01-24 19:28:00,046::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:28:00,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:00,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-461::INFO::2014-01-24 19:28:01,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-461::INFO::2014-01-24 19:28:01,040::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493083', 'lastCheck': '3.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290638', 'lastCheck': '8.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:28:01,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:01,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269515 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:02,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:02,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:28:02,708::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:02,714::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325964 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:03,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:03,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311129 s, 32.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:04,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:04,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:05,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:06,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255322 s, 40.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:06,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:06,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:07,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:07,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00436201 s, 939 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:08,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:08,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305421 s, 33.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:08,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:08,697::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-465::DEBUG::2014-01-24 19:28:10,051::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-465::INFO::2014-01-24 19:28:10,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-465::INFO::2014-01-24 19:28:10,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-466::DEBUG::2014-01-24 19:28:10,072::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-466::INFO::2014-01-24 19:28:10,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-466::INFO::2014-01-24 19:28:10,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:28:10,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:10,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264221 s, 38.8 MB/s\n'; <rc> = 0 >Thread-467::DEBUG::2014-01-24 19:28:10,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-467::INFO::2014-01-24 19:28:10,140::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-467::INFO::2014-01-24 19:28:10,142::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:28:10,700::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:10,705::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:12,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:12,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296364 s, 34.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:12,708::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:12,713::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:28:12,724::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:12,730::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000334004 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:14,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:14,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269907 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:14,717::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:14,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:16,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-470::INFO::2014-01-24 19:28:16,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-470::INFO::2014-01-24 19:28:16,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00436201', 'lastCheck': '8.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334004', 'lastCheck': '3.6', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:28:16,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283384 s, 36.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:16,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:16,731::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:17,609::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:17,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000461657 s, 8.9 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:18,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:18,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264546 s, 38.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:18,734::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:18,739::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-472::DEBUG::2014-01-24 19:28:20,138::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-472::INFO::2014-01-24 19:28:20,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-472::INFO::2014-01-24 19:28:20,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-473::DEBUG::2014-01-24 19:28:20,146::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-473::INFO::2014-01-24 19:28:20,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-473::INFO::2014-01-24 19:28:20,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-474::DEBUG::2014-01-24 19:28:20,224::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-474::INFO::2014-01-24 19:28:20,224::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-474::INFO::2014-01-24 19:28:20,224::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:28:20,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:20,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296389 s, 34.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:20,742::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:20,747::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:22,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:22,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317853 s, 32.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:28:22,740::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:22,746::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00036321 s, 942 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:22,750::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:22,755::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:24,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:24,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304005 s, 33.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:24,758::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:24,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:26,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:26,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0571318 s, 17.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:26,767::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:26,772::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:27,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:27,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00672411 s, 609 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:28,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:28,775::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:28,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:28,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341828 s, 30.0 MB/s\n'; <rc> = 0 >Thread-478::DEBUG::2014-01-24 19:28:30,225::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-478::INFO::2014-01-24 19:28:30,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-478::INFO::2014-01-24 19:28:30,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-479::DEBUG::2014-01-24 19:28:30,233::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-479::INFO::2014-01-24 19:28:30,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-479::INFO::2014-01-24 19:28:30,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-480::DEBUG::2014-01-24 19:28:30,286::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-480::INFO::2014-01-24 19:28:30,286::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-480::INFO::2014-01-24 19:28:30,286::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:28:30,800::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:30,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:30,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:30,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264159 s, 38.8 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:28:32,754::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:32,760::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000287162 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:32,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:32,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:32,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:32,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313977 s, 32.6 MB/s\n'; <rc> = 0 >Thread-482::INFO::2014-01-24 19:28:34,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-482::INFO::2014-01-24 19:28:34,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00672411', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287162', 'lastCheck': '1.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:28:34,817::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:34,822::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:34,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:34,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330584 s, 31.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:36,825::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:36,831::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:37,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:37,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266211 s, 38.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:37,639::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:37,645::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000515587 s, 7.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:38,833::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:38,839::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:39,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:39,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267905 s, 38.2 MB/s\n'; <rc> = 0 >Thread-484::DEBUG::2014-01-24 19:28:40,295::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-484::INFO::2014-01-24 19:28:40,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-484::INFO::2014-01-24 19:28:40,295::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-485::DEBUG::2014-01-24 19:28:40,301::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-485::INFO::2014-01-24 19:28:40,301::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-485::INFO::2014-01-24 19:28:40,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:28:40,842::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:40,848::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-487::DEBUG::2014-01-24 19:28:40,850::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-487::INFO::2014-01-24 19:28:40,852::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-487::INFO::2014-01-24 19:28:40,854::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:28:41,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:41,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332274 s, 30.8 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:28:42,768::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:42,775::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000648579 s, 527 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:42,859::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:42,865::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:43,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:43,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275729 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:44,868::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:44,874::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:45,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:45,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274502 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:46,877::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:46,882::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:47,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:47,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297954 s, 34.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:47,651::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:47,657::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00030529 s, 13.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:48,885::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:48,891::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:49,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:49,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331037 s, 30.9 MB/s\n'; <rc> = 0 >Thread-491::DEBUG::2014-01-24 19:28:50,848::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-491::INFO::2014-01-24 19:28:50,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-491::INFO::2014-01-24 19:28:50,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-492::DEBUG::2014-01-24 19:28:50,857::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-492::INFO::2014-01-24 19:28:50,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-492::INFO::2014-01-24 19:28:50,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:28:50,894::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:50,900::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-493::DEBUG::2014-01-24 19:28:50,922::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-493::INFO::2014-01-24 19:28:50,922::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-493::INFO::2014-01-24 19:28:50,923::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:28:51,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:51,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310442 s, 33.0 MB/s\n'; <rc> = 0 >Thread-494::INFO::2014-01-24 19:28:52,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-494::INFO::2014-01-24 19:28:52,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030529', 'lastCheck': '5.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000648579', 'lastCheck': '9.9', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:28:52,784::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:28:52,789::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000356573 s, 959 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:52,903::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:52,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:53,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:53,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330243 s, 31.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:54,912::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:54,941::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:55,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:55,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345786 s, 29.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:56,944::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:56,949::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:28:57,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:28:57,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000452659 s, 9.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:57,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:57,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271503 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:28:58,952::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:28:58,957::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:28:59,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:28:59,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342944 s, 29.9 MB/s\n'; <rc> = 0 >Thread-498::DEBUG::2014-01-24 19:29:00,929::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-498::INFO::2014-01-24 19:29:00,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-498::INFO::2014-01-24 19:29:00,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-499::DEBUG::2014-01-24 19:29:00,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-499::INFO::2014-01-24 19:29:00,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-499::INFO::2014-01-24 19:29:00,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:29:00,960::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:00,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-500::DEBUG::2014-01-24 19:29:00,986::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-500::INFO::2014-01-24 19:29:00,986::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-500::INFO::2014-01-24 19:29:00,987::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:29:01,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:01,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239295 s, 42.8 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:29:02,798::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:02,804::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000293085 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:02,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:02,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:03,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:03,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288832 s, 35.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:04,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:04,982::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:05,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:06,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267444 s, 38.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:06,985::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:06,991::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:07,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:07,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00541332 s, 757 kB/s\n'; <rc> = 0 >Thread-503::INFO::2014-01-24 19:29:07,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-503::INFO::2014-01-24 19:29:07,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541332', 'lastCheck': '0.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293085', 'lastCheck': '5.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:29:08,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:08,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312972 s, 32.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:08,994::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:09,000::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:10,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:10,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303767 s, 33.7 MB/s\n'; <rc> = 0 >Thread-506::DEBUG::2014-01-24 19:29:10,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-506::INFO::2014-01-24 19:29:10,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-506::INFO::2014-01-24 19:29:10,990::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-507::DEBUG::2014-01-24 19:29:10,996::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-507::INFO::2014-01-24 19:29:10,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-507::INFO::2014-01-24 19:29:10,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:29:11,002::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:11,008::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-508::DEBUG::2014-01-24 19:29:11,080::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-508::INFO::2014-01-24 19:29:11,081::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-508::INFO::2014-01-24 19:29:11,082::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:29:12,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:12,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267277 s, 38.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:29:12,812::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:12,819::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000787443 s, 434 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:13,011::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:13,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:14,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:14,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271062 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:15,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:15,025::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:16,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:16,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264179 s, 38.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:17,028::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:17,033::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:17,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:17,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000392826 s, 10.4 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:18,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:18,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026436 s, 38.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:19,036::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:19,041::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:20,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:20,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300047 s, 34.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:21,044::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:21,049::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-512::DEBUG::2014-01-24 19:29:21,081::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-512::INFO::2014-01-24 19:29:21,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-512::INFO::2014-01-24 19:29:21,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-513::DEBUG::2014-01-24 19:29:21,088::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-513::INFO::2014-01-24 19:29:21,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-513::INFO::2014-01-24 19:29:21,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-514::DEBUG::2014-01-24 19:29:21,351::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-514::INFO::2014-01-24 19:29:21,351::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-514::INFO::2014-01-24 19:29:21,352::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:29:22,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:22,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028248 s, 36.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:29:22,828::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:22,834::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000283997 s, 1.2 MB/s\n'; <rc> = 0 >Thread-515::INFO::2014-01-24 19:29:23,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-12::DEBUG::2014-01-24 19:29:23,053::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-515::INFO::2014-01-24 19:29:23,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392826', 'lastCheck': '5.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283997', 'lastCheck': '0.2', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:29:23,065::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:24,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:24,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267973 s, 38.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:25,077::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:25,082::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:26,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:26,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235675 s, 43.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:27,085::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:27,090::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:27,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:27,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000345236 s, 11.9 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:28,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:28,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339833 s, 30.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:29,093::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:29,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:30,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:30,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343382 s, 29.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:31,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:31,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-519::DEBUG::2014-01-24 19:29:31,353::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-519::INFO::2014-01-24 19:29:31,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-519::INFO::2014-01-24 19:29:31,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-520::DEBUG::2014-01-24 19:29:31,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-520::INFO::2014-01-24 19:29:31,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-520::INFO::2014-01-24 19:29:31,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-521::DEBUG::2014-01-24 19:29:31,555::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-521::INFO::2014-01-24 19:29:31,555::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-521::INFO::2014-01-24 19:29:31,556::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:29:32,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:32,844::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:32,857::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000839073 s, 408 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:32,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479202 s, 21.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:33,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:33,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:34,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:34,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029459 s, 34.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:35,119::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:35,125::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:36,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:37,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280941 s, 36.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:37,128::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:37,133::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:37,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:37,721::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637228 s, 6.4 MB/s\n'; <rc> = 0 >Thread-524::INFO::2014-01-24 19:29:38,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-524::INFO::2014-01-24 19:29:38,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637228', 'lastCheck': '0.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000839073', 'lastCheck': '5.4', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:29:39,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:39,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271202 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:39,136::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:39,141::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:41,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:41,144::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:41,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:41,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284258 s, 36.0 MB/s\n'; <rc> = 0 >Thread-526::DEBUG::2014-01-24 19:29:41,519::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-526::INFO::2014-01-24 19:29:41,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-526::INFO::2014-01-24 19:29:41,520::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-527::DEBUG::2014-01-24 19:29:41,528::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-527::INFO::2014-01-24 19:29:41,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-527::INFO::2014-01-24 19:29:41,529::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-528::DEBUG::2014-01-24 19:29:41,725::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-528::INFO::2014-01-24 19:29:41,726::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-528::INFO::2014-01-24 19:29:41,726::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-363::DEBUG::2014-01-24 19:29:42,869::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:42,875::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00029243 s, 1.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:43,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:43,175::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:43,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:43,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327243 s, 31.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:45,178::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:45,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:45,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:45,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425907 s, 24.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:47,187::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:47,192::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:47,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:47,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293184 s, 34.9 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:47,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:47,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00854878 s, 479 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:49,195::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:49,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:49,392::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:49,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298528 s, 34.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:51,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:51,210::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:51,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:51,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033015 s, 31.0 MB/s\n'; <rc> = 0 >Thread-533::DEBUG::2014-01-24 19:29:51,743::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-533::INFO::2014-01-24 19:29:51,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-533::INFO::2014-01-24 19:29:51,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-534::DEBUG::2014-01-24 19:29:51,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-534::INFO::2014-01-24 19:29:51,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-534::INFO::2014-01-24 19:29:51,753::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-535::DEBUG::2014-01-24 19:29:51,813::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-535::INFO::2014-01-24 19:29:51,814::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-535::INFO::2014-01-24 19:29:51,814::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-363::DEBUG::2014-01-24 19:29:52,883::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:29:52,889::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034305 s, 997 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:53,213::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:53,218::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:53,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:53,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311428 s, 32.9 MB/s\n'; <rc> = 0 >Thread-536::INFO::2014-01-24 19:29:54,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-536::INFO::2014-01-24 19:29:54,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00854878', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034305', 'lastCheck': '1.8', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:29:55,221::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:55,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:55,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:55,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289261 s, 35.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:57,230::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:57,235::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:57,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:57,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280964 s, 36.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:29:57,746::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:29:57,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000487506 s, 8.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:29:59,238::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:29:59,243::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:29:59,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:29:59,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265694 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:01,246::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:01,251::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:01,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-539::DEBUG::2014-01-24 19:30:01,837::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-539::INFO::2014-01-24 19:30:01,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-539::INFO::2014-01-24 19:30:01,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Dummy-233::DEBUG::2014-01-24 19:30:01,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339632 s, 30.2 MB/s\n'; <rc> = 0 >Thread-540::DEBUG::2014-01-24 19:30:01,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-540::INFO::2014-01-24 19:30:01,865::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-540::INFO::2014-01-24 19:30:01,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-541::DEBUG::2014-01-24 19:30:02,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-541::INFO::2014-01-24 19:30:02,050::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-541::INFO::2014-01-24 19:30:02,051::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-363::DEBUG::2014-01-24 19:30:02,898::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:02,905::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000324553 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:03,254::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:03,260::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:03,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:03,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292253 s, 35.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:05,263::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:05,270::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:05,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:06,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314089 s, 32.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:07,272::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:07,278::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:07,758::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:07,768::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00411187 s, 996 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:08,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:08,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027545 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:09,281::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:09,287::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:10,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:10,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032951 s, 31.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:11,290::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:11,295::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-545::DEBUG::2014-01-24 19:30:12,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-545::INFO::2014-01-24 19:30:12,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-545::INFO::2014-01-24 19:30:12,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-546::DEBUG::2014-01-24 19:30:12,058::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-546::INFO::2014-01-24 19:30:12,058::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-546::INFO::2014-01-24 19:30:12,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-547::DEBUG::2014-01-24 19:30:12,097::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-547::INFO::2014-01-24 19:30:12,098::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-547::INFO::2014-01-24 19:30:12,098::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Dummy-233::DEBUG::2014-01-24 19:30:12,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:12,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267074 s, 38.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:30:12,915::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:12,921::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000311139 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:13,298::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:13,304::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-548::INFO::2014-01-24 19:30:13,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-548::INFO::2014-01-24 19:30:13,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00411187', 'lastCheck': '6.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311139', 'lastCheck': '1.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:30:14,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:14,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333776 s, 30.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:15,307::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:15,312::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:16,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:16,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325248 s, 31.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:17,315::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:17,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:17,777::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:17,788::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00562427 s, 728 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:18,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:18,529::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027219 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:19,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:19,329::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:20,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:20,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0236807 s, 43.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:21,332::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:21,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-552::DEBUG::2014-01-24 19:30:22,096::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-552::INFO::2014-01-24 19:30:22,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-552::INFO::2014-01-24 19:30:22,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-553::DEBUG::2014-01-24 19:30:22,104::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-553::INFO::2014-01-24 19:30:22,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-553::INFO::2014-01-24 19:30:22,105::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:30:22,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:22,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264354 s, 38.7 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:30:22,929::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:22,935::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000375655 s, 910 kB/s\n'; <rc> = 0 >Thread-555::DEBUG::2014-01-24 19:30:23,243::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-555::INFO::2014-01-24 19:30:23,244::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-555::INFO::2014-01-24 19:30:23,244::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-12::DEBUG::2014-01-24 19:30:23,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:23,345::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:24,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:24,712::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265959 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:25,348::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:25,354::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:26,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:26,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358565 s, 28.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:27,357::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:27,363::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:27,794::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:27,804::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00388942 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:28,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:28,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561899 s, 18.2 MB/s\n'; <rc> = 0 >Thread-557::INFO::2014-01-24 19:30:29,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-557::INFO::2014-01-24 19:30:29,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00388942', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000375655', 'lastCheck': '6.2', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:30:29,366::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:29,371::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:30,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:30,944::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306184 s, 33.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:31,374::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:31,380::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 265.642 s, 40.4 MB/s']; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::misc::287::Storage.Misc::(validateDDBytes) err: ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 265.642 s, 40.4 MB/s'], size: 10737418240 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 to /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b DONE >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,239::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,626::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,651::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,654::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,661::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000561716 s, 911 kB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,661::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000561716 s, 911 kB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,664::volume::646::Storage.Volume::(setLegality) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b legality = LEGAL >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,666::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,672::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000338321 s, 1.5 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,672::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000338321 s, 1.5 MB/s'], size: 512 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,675::image::778::Storage.Image::(copyCollapsed) Finished copying a250db32-9b39-4533-8bc6-926d4ae17535:e695cd65-e815-4ace-956d-7e24736a8a43 -> a250db32-9b39-4533-8bc6-926d4ae17535:228f2939-3615-4733-ae3c-fc37390a2d0b >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,675::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43 justme False >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,675::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,792::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,793::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,887::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,891::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,891::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b justme False >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,892::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:32,946::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:32,952::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000278593 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:32,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:33,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275893 s, 37.1 MB/s\n'; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,023::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,024::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,118::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,122::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-560::DEBUG::2014-01-24 19:30:33,253::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-560::INFO::2014-01-24 19:30:33,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-560::INFO::2014-01-24 19:30:33,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-561::DEBUG::2014-01-24 19:30:33,281::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-561::INFO::2014-01-24 19:30:33,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-561::INFO::2014-01-24 19:30:33,283::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:30:33,383::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:33,388::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:35,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:35,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252518 s, 40.6 MB/s\n'; <rc> = 0 >Thread-562::DEBUG::2014-01-24 19:30:35,208::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-562::INFO::2014-01-24 19:30:35,208::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-562::INFO::2014-01-24 19:30:35,208::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}} >Thread-564::DEBUG::2014-01-24 19:30:35,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18bad2f6] >Thread-564::INFO::2014-01-24 19:30:35,354::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None) >Thread-564::INFO::2014-01-24 19:30:35,355::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b >Thread-564::DEBUG::2014-01-24 19:30:35,357::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-564::DEBUG::2014-01-24 19:30:35,362::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000566373 s, 904 kB/s\n'; <rc> = 0 >Thread-564::DEBUG::2014-01-24 19:30:35,363::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000566373 s, 904 kB/s'], size: 512 >Thread-564::DEBUG::2014-01-24 19:30:35,365::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-564::DEBUG::2014-01-24 19:30:35,370::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000491265 s, 1.0 MB/s\n'; <rc> = 0 >Thread-564::DEBUG::2014-01-24 19:30:35,371::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000491265 s, 1.0 MB/s'], size: 512 >Thread-564::INFO::2014-01-24 19:30:35,371::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-564::INFO::2014-01-24 19:30:35,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-12::DEBUG::2014-01-24 19:30:35,392::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:35,397::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-565::DEBUG::2014-01-24 19:30:35,478::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-565::INFO::2014-01-24 19:30:35,478::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a', spUUID=None, options=None) >Thread-565::INFO::2014-01-24 19:30:35,479::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Dummy-233::DEBUG::2014-01-24 19:30:37,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:37,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027641 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:37,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:37,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:37,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:37,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576322 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:39,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:39,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275936 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:39,407::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:39,413::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:41,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:41,251::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247306 s, 41.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:41,415::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:41,420::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:30:42,953::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:30:42,956::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:30:42,957::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-363::DEBUG::2014-01-24 19:30:42,962::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc'] >Thread-363::DEBUG::2014-01-24 19:30:42,963::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-363::INFO::2014-01-24 19:30:42,963::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered >Thread-363::INFO::2014-01-24 19:30:42,964::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered >Thread-363::DEBUG::2014-01-24 19:30:42,969::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:42,975::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000310485 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:43,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:43,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275074 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:43,423::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:43,428::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-569::INFO::2014-01-24 19:30:44,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-569::INFO::2014-01-24 19:30:44,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576322', 'lastCheck': '6.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310485', 'lastCheck': '1.3', 'valid': True}} >Thread-571::DEBUG::2014-01-24 19:30:45,208::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-571::INFO::2014-01-24 19:30:45,208::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-571::INFO::2014-01-24 19:30:45,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-572::DEBUG::2014-01-24 19:30:45,231::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-572::INFO::2014-01-24 19:30:45,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-572::INFO::2014-01-24 19:30:45,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:30:45,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:45,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269613 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:45,431::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:45,436::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:47,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:47,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248298 s, 41.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:47,439::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:47,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:47,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:47,826::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604611 s, 6.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:49,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:49,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:49,475::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:49,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267831 s, 38.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:51,478::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:51,483::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:51,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:51,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274078 s, 37.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:30:52,981::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:30:52,987::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00038025 s, 899 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:53,486::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:53,491::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:53,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:53,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272608 s, 37.6 MB/s\n'; <rc> = 0 >Thread-576::DEBUG::2014-01-24 19:30:55,333::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-576::INFO::2014-01-24 19:30:55,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-576::INFO::2014-01-24 19:30:55,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-577::DEBUG::2014-01-24 19:30:55,340::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-577::INFO::2014-01-24 19:30:55,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-577::INFO::2014-01-24 19:30:55,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:30:55,494::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:55,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:55,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:55,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274026 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:30:57,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:57,507::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:57,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:57,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288103 s, 35.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:30:57,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:30:57,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633663 s, 6.5 MB/s\n'; <rc> = 0 >Thread-579::INFO::2014-01-24 19:30:59,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-579::INFO::2014-01-24 19:30:59,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633663', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00038025', 'lastCheck': '6.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:30:59,510::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:30:59,515::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:30:59,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:30:59,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274851 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:01,517::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:01,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:01,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:01,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272558 s, 37.6 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:02,993::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:02,999::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000384565 s, 889 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:03,525::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:03,530::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:03,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:03,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276177 s, 37.1 MB/s\n'; <rc> = 0 >Thread-582::DEBUG::2014-01-24 19:31:05,399::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-582::INFO::2014-01-24 19:31:05,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-582::INFO::2014-01-24 19:31:05,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-583::DEBUG::2014-01-24 19:31:05,405::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-583::INFO::2014-01-24 19:31:05,405::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-583::INFO::2014-01-24 19:31:05,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:31:05,533::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:05,538::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:05,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:06,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027403 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:07,541::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:07,546::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:07,842::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:07,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627814 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:08,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:08,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244315 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:09,549::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:09,554::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:10,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:10,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275181 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:11,557::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:11,562::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:12,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:12,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276941 s, 37.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:13,006::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:13,012::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000368311 s, 929 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:13,565::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:13,569::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:14,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:14,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275972 s, 37.1 MB/s\n'; <rc> = 0 >Thread-587::INFO::2014-01-24 19:31:14,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-587::INFO::2014-01-24 19:31:14,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627814', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368311', 'lastCheck': '1.7', 'valid': True}} >Thread-589::DEBUG::2014-01-24 19:31:15,470::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-589::INFO::2014-01-24 19:31:15,470::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-589::INFO::2014-01-24 19:31:15,470::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-590::DEBUG::2014-01-24 19:31:15,476::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-590::INFO::2014-01-24 19:31:15,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-590::INFO::2014-01-24 19:31:15,477::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:31:15,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:15,577::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:16,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:16,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274274 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:17,580::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:17,585::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:17,851::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-120::DEBUG::2014-01-24 19:31:17,851::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:31:17,853::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:17,859::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000626598 s, 3.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:17,859::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000626598 s, 3.3 MB/s'], size: 2048 >Thread-120::DEBUG::2014-01-24 19:31:17,859::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-120::DEBUG::2014-01-24 19:31:17,859::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:31:17,860::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:18,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:18,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134384 s, 7.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:19,588::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:19,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:20,114::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:20,115::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6'] >Thread-120::INFO::2014-01-24 19:31:20,115::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-120::INFO::2014-01-24 19:31:20,115::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-120::INFO::2014-01-24 19:31:20,116::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-120::DEBUG::2014-01-24 19:31:20,116::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:20,210::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:20,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:20,219::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528757 s, 7.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:20,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:20,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261956 s, 39.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:21,596::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:21,601::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:22,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:22,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273895 s, 37.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:23,018::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:23,024::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000314168 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:23,604::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:23,609::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:24,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:24,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280439 s, 36.5 MB/s\n'; <rc> = 0 >Thread-594::DEBUG::2014-01-24 19:31:25,531::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-594::INFO::2014-01-24 19:31:25,532::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-594::INFO::2014-01-24 19:31:25,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-595::DEBUG::2014-01-24 19:31:25,537::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-595::INFO::2014-01-24 19:31:25,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-595::INFO::2014-01-24 19:31:25,539::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:31:25,612::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:25,617::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:26,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:26,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247262 s, 41.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:27,620::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:27,625::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:28,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:28,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027644 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:29,627::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:29,632::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-597::INFO::2014-01-24 19:31:29,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-597::INFO::2014-01-24 19:31:29,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528757', 'lastCheck': '9.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314168', 'lastCheck': '6.8', 'valid': True}} >Thread-120::DEBUG::2014-01-24 19:31:30,224::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:30,229::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613268 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:30,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:30,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272225 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:31,635::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:31,640::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:32,897::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:32,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248436 s, 41.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:33,031::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:33,037::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000341146 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:33,643::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:33,648::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:34,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:35,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271908 s, 37.7 MB/s\n'; <rc> = 0 >Thread-600::DEBUG::2014-01-24 19:31:35,596::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-600::INFO::2014-01-24 19:31:35,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-600::INFO::2014-01-24 19:31:35,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-601::DEBUG::2014-01-24 19:31:35,603::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-601::INFO::2014-01-24 19:31:35,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-601::INFO::2014-01-24 19:31:35,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:31:35,651::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:35,656::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:37,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:37,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276133 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:37,659::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:37,664::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:39,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:39,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244125 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:39,667::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:39,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:40,235::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:40,240::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540273 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:41,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:41,187::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234463 s, 43.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:41,674::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:41,679::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:43,045::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:43,050::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000296804 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:43,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:43,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272963 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:43,682::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:43,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-605::INFO::2014-01-24 19:31:45,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-605::INFO::2014-01-24 19:31:45,033::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540273', 'lastCheck': '4.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296804', 'lastCheck': '2.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:31:45,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:45,311::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274594 s, 37.3 MB/s\n'; <rc> = 0 >Thread-607::DEBUG::2014-01-24 19:31:45,649::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-607::INFO::2014-01-24 19:31:45,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-607::INFO::2014-01-24 19:31:45,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-12::DEBUG::2014-01-24 19:31:45,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-608::DEBUG::2014-01-24 19:31:45,697::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-608::INFO::2014-01-24 19:31:45,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-12::DEBUG::2014-01-24 19:31:45,700::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-608::INFO::2014-01-24 19:31:45,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:31:47,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:47,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245587 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:47,710::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:47,715::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:49,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:49,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273611 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:49,718::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:49,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:31:50,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:31:50,251::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608641 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:51,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:51,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269651 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:51,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:51,731::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:31:53,056::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:31:53,062::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000315865 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:53,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:53,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273655 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:53,734::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:53,738::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:55,563::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:55,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269304 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:55,741::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:55,746::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-612::DEBUG::2014-01-24 19:31:55,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-612::INFO::2014-01-24 19:31:55,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-612::INFO::2014-01-24 19:31:55,751::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-613::DEBUG::2014-01-24 19:31:55,757::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-613::INFO::2014-01-24 19:31:55,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-613::INFO::2014-01-24 19:31:55,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:31:57,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:57,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244334 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:57,750::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:57,757::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:31:59,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:31:59,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270432 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:31:59,760::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:31:59,765::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-615::INFO::2014-01-24 19:32:00,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-615::INFO::2014-01-24 19:32:00,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608641', 'lastCheck': '9.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315865', 'lastCheck': '7.1', 'valid': True}} >Thread-120::DEBUG::2014-01-24 19:32:00,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:00,262::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659213 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:01,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:01,768::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:01,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:01,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448708 s, 22.8 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:03,069::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:03,075::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00037143 s, 921 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:03,788::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:03,793::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:03,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:03,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275091 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:05,796::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:05,801::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-618::DEBUG::2014-01-24 19:32:05,812::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-618::INFO::2014-01-24 19:32:05,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-618::INFO::2014-01-24 19:32:05,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-619::DEBUG::2014-01-24 19:32:05,818::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-619::INFO::2014-01-24 19:32:05,818::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-619::INFO::2014-01-24 19:32:05,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:32:05,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:05,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277639 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:07,804::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:07,809::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:07,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:08,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275264 s, 37.2 MB/s\n'; <rc> = 0 >Thread-621::DEBUG::2014-01-24 19:32:08,657::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-621::INFO::2014-01-24 19:32:08,658::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-621::INFO::2014-01-24 19:32:08,660::sd::582::Storage.StorageDomain::(getVMsList) vmList=[] >Thread-621::INFO::2014-01-24 19:32:08,661::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[] >Thread-621::INFO::2014-01-24 19:32:08,661::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}} >Thread-12::DEBUG::2014-01-24 19:32:09,812::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:09,817::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:10,010::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:10,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02757 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:32:10,267::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:10,274::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000522786 s, 7.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:11,819::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:11,824::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:12,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:12,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269641 s, 38.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:13,082::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:13,088::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328456 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:13,827::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:13,832::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:14,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:14,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243479 s, 42.1 MB/s\n'; <rc> = 0 >Thread-624::DEBUG::2014-01-24 19:32:14,256::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae] >Thread-624::INFO::2014-01-24 19:32:14,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None) >Thread-624::DEBUG::2014-01-24 19:32:14,257::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-624::DEBUG::2014-01-24 19:32:14,352::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-624::DEBUG::2014-01-24 19:32:14,357::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-624::INFO::2014-01-24 19:32:14,358::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b >Thread-624::DEBUG::2014-01-24 19:32:14,360::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-624::DEBUG::2014-01-24 19:32:14,366::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000536287 s, 955 kB/s\n'; <rc> = 0 >Thread-624::DEBUG::2014-01-24 19:32:14,366::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000536287 s, 955 kB/s'], size: 512 >Thread-624::DEBUG::2014-01-24 19:32:14,368::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-624::DEBUG::2014-01-24 19:32:14,373::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000491784 s, 1.0 MB/s\n'; <rc> = 0 >Thread-624::DEBUG::2014-01-24 19:32:14,374::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000491784 s, 1.0 MB/s'], size: 512 >Thread-624::INFO::2014-01-24 19:32:14,374::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-624::INFO::2014-01-24 19:32:14,374::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-625::DEBUG::2014-01-24 19:32:14,384::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae] >Thread-625::INFO::2014-01-24 19:32:14,384::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None) >Thread-625::INFO::2014-01-24 19:32:14,397::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': []} >Thread-626::DEBUG::2014-01-24 19:32:14,411::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae] >Thread-626::INFO::2014-01-24 19:32:14,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-626::INFO::2014-01-24 19:32:14,412::sd::582::Storage.StorageDomain::(getVMsList) vmList=[] >Thread-626::INFO::2014-01-24 19:32:14,412::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[] >Thread-626::INFO::2014-01-24 19:32:14,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}} >Thread-627::DEBUG::2014-01-24 19:32:14,717::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1d54c437] >Thread-627::INFO::2014-01-24 19:32:14,717::logUtils::44::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmUUID='', srcImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', srcVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', dstImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', dstVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', description='', dstSdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', volType=6, volFormat=5, preallocate=1, postZero='false', force='false') >Thread-627::DEBUG::2014-01-24 19:32:14,717::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-627::DEBUG::2014-01-24 19:32:14,810::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-627::DEBUG::2014-01-24 19:32:14,814::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-627::INFO::2014-01-24 19:32:14,814::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist ['228f2939-3615-4733-ae3c-fc37390a2d0b'] >Thread-627::DEBUG::2014-01-24 19:32:14,816::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-627::DEBUG::2014-01-24 19:32:14,822::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000404974 s, 1.3 MB/s\n'; <rc> = 0 >Thread-627::DEBUG::2014-01-24 19:32:14,822::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000404974 s, 1.3 MB/s'], size: 512 >Thread-627::DEBUG::2014-01-24 19:32:14,824::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-627::DEBUG::2014-01-24 19:32:14,830::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000436804 s, 1.2 MB/s\n'; <rc> = 0 >Thread-627::DEBUG::2014-01-24 19:32:14,830::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000436804 s, 1.2 MB/s'], size: 512 >Thread-627::DEBUG::2014-01-24 19:32:14,830::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-627::DEBUG::2014-01-24 19:32:14,924::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-627::DEBUG::2014-01-24 19:32:14,928::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-627::DEBUG::2014-01-24 19:32:14,931::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-627::DEBUG::2014-01-24 19:32:14,936::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000551467 s, 928 kB/s\n'; <rc> = 0 >Thread-627::DEBUG::2014-01-24 19:32:14,937::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000551467 s, 928 kB/s'], size: 512 >Thread-627::INFO::2014-01-24 19:32:14,967::logUtils::47::dispatcher::(wrapper) Run and protect: copyImage, Return response: None >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,038::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,131::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,135::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,137::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,143::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000500758 s, 1.0 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,143::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000500758 s, 1.0 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,145::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image df30ebf7-0d71-40b0-a33e-07170bdead7d does not exist in domain 464da998-ebd2-46a1-bab0-1c02a21a165e >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,146::image::645::Storage.Image::(copyCollapsed) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 vmUUID= srcImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d srcVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d dstVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstSdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e volType=6 volFormat=RAW preallocate=PREALLOCATED force=False postZero=False >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,148::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,153::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000509018 s, 1.0 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,154::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000509018 s, 1.0 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,156::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,161::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000498594 s, 1.0 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,161::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000498594 s, 1.0 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,163::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,169::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000367899 s, 1.4 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,169::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000367899 s, 1.4 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,171::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,176::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000370651 s, 1.4 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,177::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000370651 s, 1.4 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,179::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,184::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000418972 s, 1.2 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,184::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000418972 s, 1.2 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,187::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,192::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000344267 s, 1.5 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,192::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000344267 s, 1.5 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,192::image::695::Storage.Image::(copyCollapsed) copy source a250db32-9b39-4533-8bc6-926d4ae17535:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b vol size 20971520 destination 464da998-ebd2-46a1-bab0-1c02a21a165e:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b apparentsize 20971520 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,193::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain 464da998-ebd2-46a1-bab0-1c02a21a165e has vollist [] >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,193::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d for image's volumes >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,230::volume::443::Storage.Volume::(create) Creating volume 228f2939-3615-4733-ae3c-fc37390a2d0b >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,333::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10 oflag=direct' (cwd None) >Thread-628::INFO::2014-01-24 19:32:15,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-628::INFO::2014-01-24 19:32:15,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522786', 'lastCheck': '5.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328456', 'lastCheck': '2.3', 'valid': True}} >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,683::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10+0 records in', '10+0 records out', '10485760 bytes (10 MB) copied, 0.326709 s, 32.1 MB/s']; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,683::misc::287::Storage.Misc::(validateDDBytes) err: ['10+0 records in', '10+0 records out', '10485760 bytes (10 MB) copied, 0.326709 s, 32.1 MB/s'], size: 10485760 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,683::fileVolume::144::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b with size = 20480 sectors >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,764::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 228f2939-3615-4733-ae3c-fc37390a2d0b >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,773::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,775::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,781::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000450689 s, 1.1 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,781::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000450689 s, 1.1 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:15,835::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:15,842::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-630::DEBUG::2014-01-24 19:32:15,883::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-630::INFO::2014-01-24 19:32:15,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-630::INFO::2014-01-24 19:32:15,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-631::DEBUG::2014-01-24 19:32:15,889::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-631::INFO::2014-01-24 19:32:15,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-631::INFO::2014-01-24 19:32:15,890::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,951::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,952::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,046::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,051::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,053::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,059::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000459774 s, 1.1 MB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,059::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000459774 s, 1.1 MB/s'], size: 512 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:16,059::volume::789::Storage.Volume::(prepare) Volume: preparing volume 464da998-ebd2-46a1-bab0-1c02a21a165e/228f2939-3615-4733-ae3c-fc37390a2d0b >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,092::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) to /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) START >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,095::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b of=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10240 oflag=direct' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:16,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:16,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286536 s, 35.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:17,847::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:17,853::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:18,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:18,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281437 s, 36.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:19,856::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:19,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:32:20,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:20,286::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780496 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:20,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:20,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028168 s, 36.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:21,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:21,871::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:22,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:22,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266579 s, 38.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:23,270::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:23,283::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00389469 s, 87.8 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:23,874::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:23,880::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:24,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:24,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271936 s, 37.7 MB/s\n'; <rc> = 0 >Thread-634::DEBUG::2014-01-24 19:32:25,248::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-634::INFO::2014-01-24 19:32:25,248::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-634::INFO::2014-01-24 19:32:25,249::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:32:25,883::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:25,889::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-636::DEBUG::2014-01-24 19:32:25,935::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-636::INFO::2014-01-24 19:32:25,935::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-636::INFO::2014-01-24 19:32:25,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-637::DEBUG::2014-01-24 19:32:25,942::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-637::INFO::2014-01-24 19:32:25,942::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-637::INFO::2014-01-24 19:32:25,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144096952320', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:32:26,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:26,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388022 s, 26.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:27,892::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:27,899::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:28,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:28,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313581 s, 32.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:29,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:29,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:32:30,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:30,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609473 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:30,816::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:30,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03253 s, 31.5 MB/s\n'; <rc> = 0 >Thread-639::INFO::2014-01-24 19:32:31,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-639::INFO::2014-01-24 19:32:31,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609473', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00389469', 'lastCheck': '8.3', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:32:31,911::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:31,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:32,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:32,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246869 s, 41.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:33,290::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:33,300::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000316303 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:33,920::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:33,926::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:34,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:35,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312155 s, 32.8 MB/s\n'; <rc> = 0 >Thread-642::DEBUG::2014-01-24 19:32:35,258::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-642::INFO::2014-01-24 19:32:35,258::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-642::INFO::2014-01-24 19:32:35,258::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:32:35,929::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:35,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-643::DEBUG::2014-01-24 19:32:36,106::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-643::INFO::2014-01-24 19:32:36,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-643::INFO::2014-01-24 19:32:36,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-644::DEBUG::2014-01-24 19:32:36,114::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-644::INFO::2014-01-24 19:32:36,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-644::INFO::2014-01-24 19:32:36,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '143585509376', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:32:37,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:37,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275486 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:37,938::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:37,944::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:39,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:39,137::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028972 s, 35.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:39,947::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:39,953::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:32:40,303::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:40,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00730193 s, 561 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:41,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:41,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289547 s, 35.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:41,956::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:41,962::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:43,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:43,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027532 s, 37.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:43,312::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:43,318::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000319081 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:43,965::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:43,971::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-648::DEBUG::2014-01-24 19:32:45,266::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-648::INFO::2014-01-24 19:32:45,266::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-648::INFO::2014-01-24 19:32:45,267::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:32:45,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:45,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279901 s, 36.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:45,974::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:45,980::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-649::DEBUG::2014-01-24 19:32:46,168::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-649::INFO::2014-01-24 19:32:46,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-649::INFO::2014-01-24 19:32:46,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-650::DEBUG::2014-01-24 19:32:46,174::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-650::INFO::2014-01-24 19:32:46,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-650::INFO::2014-01-24 19:32:46,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '143037890560', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-651::INFO::2014-01-24 19:32:46,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-651::INFO::2014-01-24 19:32:46,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00730193', 'lastCheck': '6.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319081', 'lastCheck': '3.5', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:32:47,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:47,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248655 s, 41.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:47,983::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:47,990::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:49,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:49,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267928 s, 38.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:49,993::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:49,998::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:32:50,322::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:32:50,333::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00475881 s, 861 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:51,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:51,524::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278288 s, 36.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:52,001::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:52,007::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:32:53,327::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:32:53,334::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000274692 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:53,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:53,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278732 s, 36.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:54,010::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:54,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-655::DEBUG::2014-01-24 19:32:55,274::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-655::INFO::2014-01-24 19:32:55,275::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-655::INFO::2014-01-24 19:32:55,275::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:32:55,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:55,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275353 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:56,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:56,025::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-657::DEBUG::2014-01-24 19:32:56,222::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-657::INFO::2014-01-24 19:32:56,223::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-657::INFO::2014-01-24 19:32:56,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-658::DEBUG::2014-01-24 19:32:56,228::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-658::INFO::2014-01-24 19:32:56,228::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-658::INFO::2014-01-24 19:32:56,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '142558658560', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:32:57,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:57,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242273 s, 42.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:32:58,028::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:32:58,034::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:32:59,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:32:59,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276318 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:00,037::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:00,042::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:00,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:00,346::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00171051 s, 2.4 MB/s\n'; <rc> = 0 >Thread-660::DEBUG::2014-01-24 19:33:01,473::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-660::INFO::2014-01-24 19:33:01,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-660::INFO::2014-01-24 19:33:01,479::sd::582::Storage.StorageDomain::(getVMsList) vmList=[] >Thread-660::INFO::2014-01-24 19:33:01,479::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[] >Thread-660::INFO::2014-01-24 19:33:01,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}} >Dummy-233::DEBUG::2014-01-24 19:33:01,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:01,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271546 s, 37.7 MB/s\n'; <rc> = 0 >Thread-661::INFO::2014-01-24 19:33:02,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-661::INFO::2014-01-24 19:33:02,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171051', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274692', 'lastCheck': '8.7', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:33:02,046::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:02,051::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-663::DEBUG::2014-01-24 19:33:03,541::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-663::INFO::2014-01-24 19:33:03,542::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-363::DEBUG::2014-01-24 19:33:03,555::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:03,562::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000333791 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:03,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:03,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276184 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:04,055::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:04,060::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-663::INFO::2014-01-24 19:33:04,536::sd::582::Storage.StorageDomain::(getVMsList) vmList=[] >Thread-663::INFO::2014-01-24 19:33:04,537::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[] >Thread-663::INFO::2014-01-24 19:33:04,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}} >Thread-665::DEBUG::2014-01-24 19:33:05,283::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-665::INFO::2014-01-24 19:33:05,284::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-665::INFO::2014-01-24 19:33:05,284::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:33:05,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:05,975::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266474 s, 38.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:06,064::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:06,069::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-666::DEBUG::2014-01-24 19:33:06,274::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-666::INFO::2014-01-24 19:33:06,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-666::INFO::2014-01-24 19:33:06,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-667::DEBUG::2014-01-24 19:33:06,305::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-667::INFO::2014-01-24 19:33:06,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-667::INFO::2014-01-24 19:33:06,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '141998227456', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:33:07,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:08,046::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319895 s, 32.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:08,072::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:08,077::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:10,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:10,081::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:10,091::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:10,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498976 s, 20.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:10,352::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:10,359::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788294 s, 5.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:12,104::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:12,110::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:12,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:12,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273356 s, 37.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:33:13,602::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:13,609::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328964 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:14,114::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:14,120::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:14,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:14,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305274 s, 33.5 MB/s\n'; <rc> = 0 >Thread-671::DEBUG::2014-01-24 19:33:15,291::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-671::INFO::2014-01-24 19:33:15,292::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-671::INFO::2014-01-24 19:33:15,292::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:33:16,123::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:16,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:16,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:16,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291405 s, 35.1 MB/s\n'; <rc> = 0 >Thread-672::DEBUG::2014-01-24 19:33:16,459::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-672::INFO::2014-01-24 19:33:16,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-672::INFO::2014-01-24 19:33:16,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-673::DEBUG::2014-01-24 19:33:16,469::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-673::INFO::2014-01-24 19:33:16,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-673::INFO::2014-01-24 19:33:16,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '141499924480', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-674::INFO::2014-01-24 19:33:17,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-674::INFO::2014-01-24 19:33:17,229::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788294', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328964', 'lastCheck': '3.6', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:33:18,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:18,138::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:18,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:18,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274078 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:20,141::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:20,147::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:20,370::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:20,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000857771 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:20,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:20,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271696 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:22,150::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:22,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:22,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:22,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026939 s, 38.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:33:23,620::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:23,626::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000303332 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:24,159::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:24,164::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:24,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:24,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267149 s, 38.3 MB/s\n'; <rc> = 0 >Thread-678::DEBUG::2014-01-24 19:33:25,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-678::INFO::2014-01-24 19:33:25,305::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-678::INFO::2014-01-24 19:33:25,305::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:33:26,167::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:26,174::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-680::DEBUG::2014-01-24 19:33:26,533::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-680::INFO::2014-01-24 19:33:26,533::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-680::INFO::2014-01-24 19:33:26,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-681::DEBUG::2014-01-24 19:33:26,540::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-681::INFO::2014-01-24 19:33:26,541::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-681::INFO::2014-01-24 19:33:26,542::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140934479872', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:33:26,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:26,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270368 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:28,177::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:28,182::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:28,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:28,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269772 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:30,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:30,191::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:30,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:30,388::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569969 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:30,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:30,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284445 s, 36.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:32,194::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:32,200::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-683::INFO::2014-01-24 19:33:32,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-683::INFO::2014-01-24 19:33:32,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569969', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303332', 'lastCheck': '8.8', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:33:32,797::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:32,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274297 s, 37.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:33:33,634::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:33,648::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000329111 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:34,203::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:34,209::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:34,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:34,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029118 s, 35.2 MB/s\n'; <rc> = 0 >Thread-685::DEBUG::2014-01-24 19:33:35,315::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-685::INFO::2014-01-24 19:33:35,315::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-685::INFO::2014-01-24 19:33:35,316::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:33:36,212::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:36,218::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-687::DEBUG::2014-01-24 19:33:36,646::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-687::INFO::2014-01-24 19:33:36,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-687::INFO::2014-01-24 19:33:36,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-688::DEBUG::2014-01-24 19:33:36,653::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-688::INFO::2014-01-24 19:33:36,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-688::INFO::2014-01-24 19:33:36,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140467634176', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:33:36,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:36,987::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317844 s, 32.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:38,221::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:38,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:38,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:39,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276227 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:40,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:40,235::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:40,394::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:40,401::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000467485 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:41,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:41,114::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265756 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:42,238::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:42,244::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:43,124::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:43,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274186 s, 37.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:33:43,663::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:43,670::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000305558 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:44,247::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:44,253::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:45,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:45,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291725 s, 35.1 MB/s\n'; <rc> = 0 >Thread-692::DEBUG::2014-01-24 19:33:45,353::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-692::INFO::2014-01-24 19:33:45,353::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-692::INFO::2014-01-24 19:33:45,354::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:33:46,256::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:46,262::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-693::DEBUG::2014-01-24 19:33:46,717::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-693::INFO::2014-01-24 19:33:46,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-693::INFO::2014-01-24 19:33:46,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-694::DEBUG::2014-01-24 19:33:46,724::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-694::INFO::2014-01-24 19:33:46,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-694::INFO::2014-01-24 19:33:46,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140025069568', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:33:47,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:47,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264759 s, 38.7 MB/s\n'; <rc> = 0 >Thread-695::INFO::2014-01-24 19:33:47,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-695::INFO::2014-01-24 19:33:47,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467485', 'lastCheck': '7.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305558', 'lastCheck': '3.9', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:33:48,265::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:48,271::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:49,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:49,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276838 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:50,274::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:50,280::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:33:50,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:33:50,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709214 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:51,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:51,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290596 s, 35.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:52,283::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:52,288::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:53,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:53,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285457 s, 35.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:33:53,687::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:33:53,694::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000637782 s, 536 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:54,291::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:54,297::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-699::DEBUG::2014-01-24 19:33:55,376::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-699::INFO::2014-01-24 19:33:55,376::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-699::INFO::2014-01-24 19:33:55,376::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:33:55,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:55,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349918 s, 29.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:56,300::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:56,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-700::DEBUG::2014-01-24 19:33:56,785::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-700::INFO::2014-01-24 19:33:56,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-700::INFO::2014-01-24 19:33:56,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-701::DEBUG::2014-01-24 19:33:56,792::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-701::INFO::2014-01-24 19:33:56,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-701::INFO::2014-01-24 19:33:56,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '139624153088', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:33:57,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:57,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285026 s, 35.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:33:58,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:33:58,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:33:59,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:33:59,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.023948 s, 42.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:00,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:00,322::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:00,418::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:34:00,425::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673859 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:01,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:01,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331499 s, 30.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:02,325::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:02,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-704::INFO::2014-01-24 19:34:02,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-704::INFO::2014-01-24 19:34:02,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673859', 'lastCheck': '2.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000637782', 'lastCheck': '9.2', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:34:03,712::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:03,719::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034759 s, 984 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:03,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:03,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298949 s, 34.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:04,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:04,340::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-706::DEBUG::2014-01-24 19:34:05,384::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-706::INFO::2014-01-24 19:34:05,384::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-706::INFO::2014-01-24 19:34:05,385::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:34:05,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:05,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277666 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:06,343::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:06,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-708::DEBUG::2014-01-24 19:34:06,843::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-708::INFO::2014-01-24 19:34:06,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-708::INFO::2014-01-24 19:34:06,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-709::DEBUG::2014-01-24 19:34:06,851::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-709::INFO::2014-01-24 19:34:06,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-709::INFO::2014-01-24 19:34:06,853::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '139211866112', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:34:07,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:07,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272281 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:08,352::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:08,358::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:09,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:10,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309266 s, 33.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:10,361::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:10,366::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:10,430::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:34:10,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614446 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:12,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:12,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028408 s, 36.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:12,369::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:12,375::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:34:13,730::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:13,736::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000312952 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:14,111::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:14,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277424 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:14,378::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:14,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-713::DEBUG::2014-01-24 19:34:15,400::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-713::INFO::2014-01-24 19:34:15,401::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-713::INFO::2014-01-24 19:34:15,401::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:34:16,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:16,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274417 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:16,387::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:16,393::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-714::DEBUG::2014-01-24 19:34:16,910::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-714::INFO::2014-01-24 19:34:16,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-714::INFO::2014-01-24 19:34:16,911::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-715::DEBUG::2014-01-24 19:34:16,918::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-715::INFO::2014-01-24 19:34:16,918::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-715::INFO::2014-01-24 19:34:16,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '138804822016', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-716::INFO::2014-01-24 19:34:18,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-716::INFO::2014-01-24 19:34:18,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614446', 'lastCheck': '7.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312952', 'lastCheck': '4.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:34:18,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:18,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246897 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:18,396::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:18,402::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:20,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:20,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244103 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:20,405::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:20,410::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:20,441::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:34:20,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00204618 s, 2.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:22,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:22,414::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:22,425::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:22,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303951 s, 33.7 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:34:23,743::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:23,756::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00375401 s, 91.1 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:24,437::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:24,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:24,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:24,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268523 s, 38.1 MB/s\n'; <rc> = 0 >Thread-720::DEBUG::2014-01-24 19:34:25,409::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-720::INFO::2014-01-24 19:34:25,409::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-720::INFO::2014-01-24 19:34:25,409::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:34:26,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:26,452::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:26,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:26,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282501 s, 36.2 MB/s\n'; <rc> = 0 >Thread-721::DEBUG::2014-01-24 19:34:26,972::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-721::INFO::2014-01-24 19:34:26,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-721::INFO::2014-01-24 19:34:26,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-722::DEBUG::2014-01-24 19:34:26,977::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-722::INFO::2014-01-24 19:34:26,978::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-722::INFO::2014-01-24 19:34:26,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '138331160576', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:34:28,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:28,461::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:28,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:28,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274963 s, 37.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:30,455::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:30,464::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:30,476::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:30,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473304 s, 865 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:30,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:30,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271033 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:32,491::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:32,497::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:32,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:32,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273861 s, 37.4 MB/s\n'; <rc> = 0 >Thread-725::INFO::2014-01-24 19:34:33,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-725::INFO::2014-01-24 19:34:33,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473304', 'lastCheck': '2.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00375401', 'lastCheck': '9.4', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:34:33,764::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:33,778::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00117247 s, 292 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:34,500::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:34,506::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:34,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:34,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275805 s, 37.1 MB/s\n'; <rc> = 0 >Thread-727::DEBUG::2014-01-24 19:34:35,419::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-727::INFO::2014-01-24 19:34:35,419::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-727::INFO::2014-01-24 19:34:35,419::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:34:36,509::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:36,515::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:36,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:36,894::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274924 s, 37.2 MB/s\n'; <rc> = 0 >Thread-729::DEBUG::2014-01-24 19:34:37,036::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-729::INFO::2014-01-24 19:34:37,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-729::INFO::2014-01-24 19:34:37,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-730::DEBUG::2014-01-24 19:34:37,046::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-730::INFO::2014-01-24 19:34:37,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-730::INFO::2014-01-24 19:34:37,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '137878470656', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:34:38,518::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:38,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:38,903::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:38,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275808 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:40,496::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:34:40,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000910559 s, 4.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:40,526::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:40,532::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:40,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:41,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352098 s, 29.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:42,535::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:42,541::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:43,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:43,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263489 s, 38.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:34:43,790::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:43,796::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000270114 s, 1.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:44,544::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:44,549::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:45,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:45,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265174 s, 38.6 MB/s\n'; <rc> = 0 >Thread-734::DEBUG::2014-01-24 19:34:45,428::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-734::INFO::2014-01-24 19:34:45,428::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-734::INFO::2014-01-24 19:34:45,429::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:34:46,552::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:46,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:47,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-735::DEBUG::2014-01-24 19:34:47,192::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-735::INFO::2014-01-24 19:34:47,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-735::INFO::2014-01-24 19:34:47,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-736::DEBUG::2014-01-24 19:34:47,205::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-736::INFO::2014-01-24 19:34:47,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-736::INFO::2014-01-24 19:34:47,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '137373876224', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:34:47,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456084 s, 22.5 MB/s\n'; <rc> = 0 >Thread-737::INFO::2014-01-24 19:34:48,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-737::INFO::2014-01-24 19:34:48,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910559', 'lastCheck': '7.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270114', 'lastCheck': '4.6', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:34:48,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:48,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:49,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:49,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341799 s, 30.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:34:50,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:34:50,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00512707 s, 799 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:50,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:50,620::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:51,332::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:51,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271926 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:52,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:52,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:53,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:53,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243802 s, 42.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:34:53,804::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:34:53,814::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00103514 s, 330 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:54,631::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:54,636::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-741::DEBUG::2014-01-24 19:34:55,446::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-741::INFO::2014-01-24 19:34:55,447::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-741::INFO::2014-01-24 19:34:55,447::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:34:55,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:55,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280766 s, 36.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:56,639::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:56,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-742::DEBUG::2014-01-24 19:34:57,258::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-742::INFO::2014-01-24 19:34:57,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-742::INFO::2014-01-24 19:34:57,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-743::DEBUG::2014-01-24 19:34:57,264::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-743::INFO::2014-01-24 19:34:57,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-743::INFO::2014-01-24 19:34:57,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '136965783552', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:34:57,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:57,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026564 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:34:58,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:34:58,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:34:59,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:34:59,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242085 s, 42.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:35:00,525::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:00,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000431949 s, 9.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:00,657::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:00,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:01,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:01,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274848 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:02,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:02,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-746::INFO::2014-01-24 19:35:03,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-746::INFO::2014-01-24 19:35:03,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431949', 'lastCheck': '3.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103514', 'lastCheck': '9.9', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:35:03,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:03,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272518 s, 37.6 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:03,823::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:03,832::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000310336 s, 1.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:04,675::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:04,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-748::DEBUG::2014-01-24 19:35:05,474::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-748::INFO::2014-01-24 19:35:05,474::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-748::INFO::2014-01-24 19:35:05,474::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:35:05,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:05,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244286 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:06,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:06,689::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-750::DEBUG::2014-01-24 19:35:07,321::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-750::INFO::2014-01-24 19:35:07,321::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-750::INFO::2014-01-24 19:35:07,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-751::DEBUG::2014-01-24 19:35:07,359::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-751::INFO::2014-01-24 19:35:07,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-751::INFO::2014-01-24 19:35:07,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '136453816320', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:35:07,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:07,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278432 s, 36.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:08,692::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:08,698::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:09,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:09,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273352 s, 37.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:35:10,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:10,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00248918 s, 1.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:10,701::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:10,707::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:11,967::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:12,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235727 s, 43.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:12,710::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:12,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:13,840::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:13,847::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000314732 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:14,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:14,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269514 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:14,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:14,725::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-754::DEBUG::2014-01-24 19:35:15,482::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-754::INFO::2014-01-24 19:35:15,483::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-754::INFO::2014-01-24 19:35:15,483::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:35:16,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:16,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318635 s, 32.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:16,728::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:16,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-756::DEBUG::2014-01-24 19:35:17,446::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-756::INFO::2014-01-24 19:35:17,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-756::INFO::2014-01-24 19:35:17,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-757::DEBUG::2014-01-24 19:35:17,452::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-757::INFO::2014-01-24 19:35:17,452::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-757::INFO::2014-01-24 19:35:17,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '135868416000', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:35:18,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:18,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024307 s, 42.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:18,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:18,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-758::INFO::2014-01-24 19:35:18,806::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-758::INFO::2014-01-24 19:35:18,806::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00248918', 'lastCheck': '8.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314732', 'lastCheck': '5.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:35:20,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:20,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243783 s, 42.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:35:20,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:20,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000439539 s, 9.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:20,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:20,751::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:22,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:22,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026066 s, 39.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:22,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:22,760::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:23,855::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:23,861::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000362192 s, 944 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:24,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:24,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277695 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:24,763::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:24,769::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-762::DEBUG::2014-01-24 19:35:25,494::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-762::INFO::2014-01-24 19:35:25,494::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-762::INFO::2014-01-24 19:35:25,495::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:35:26,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:26,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288584 s, 35.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:26,772::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:26,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-763::DEBUG::2014-01-24 19:35:27,565::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-763::INFO::2014-01-24 19:35:27,565::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-763::INFO::2014-01-24 19:35:27,565::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-764::DEBUG::2014-01-24 19:35:27,572::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-764::INFO::2014-01-24 19:35:27,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-764::INFO::2014-01-24 19:35:27,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '135355170816', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:35:28,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:28,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304992 s, 33.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:28,781::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:28,786::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:30,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:30,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:30,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000918078 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:30,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764724 s, 13.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:30,789::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:30,795::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:32,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:32,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324698 s, 31.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:32,798::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:32,804::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:33,872::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:33,878::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000313406 s, 1.1 MB/s\n'; <rc> = 0 >Thread-767::INFO::2014-01-24 19:35:34,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-767::INFO::2014-01-24 19:35:34,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000918078', 'lastCheck': '3.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313406', 'lastCheck': '0.2', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:35:34,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:34,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272044 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:34,807::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:34,813::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-769::DEBUG::2014-01-24 19:35:35,502::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-769::INFO::2014-01-24 19:35:35,502::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-769::INFO::2014-01-24 19:35:35,502::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:35:36,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:36,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:36,826::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:36,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048885 s, 20.9 MB/s\n'; <rc> = 0 >Thread-771::DEBUG::2014-01-24 19:35:37,619::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-771::INFO::2014-01-24 19:35:37,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-771::INFO::2014-01-24 19:35:37,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-772::DEBUG::2014-01-24 19:35:37,646::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-772::INFO::2014-01-24 19:35:37,646::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-772::INFO::2014-01-24 19:35:37,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '134877020160', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:35:38,839::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:38,845::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:38,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:38,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356187 s, 28.7 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:35:40,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:40,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00559322 s, 732 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:40,848::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:40,854::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:40,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:41,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028187 s, 36.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:42,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:42,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:43,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:43,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027645 s, 37.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:43,880::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:35:43,883::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:35:43,884::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-363::DEBUG::2014-01-24 19:35:43,897::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc'] >Thread-363::DEBUG::2014-01-24 19:35:43,898::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-363::INFO::2014-01-24 19:35:43,898::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered >Thread-363::INFO::2014-01-24 19:35:43,899::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered >Thread-363::DEBUG::2014-01-24 19:35:43,904::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:43,922::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00432184 s, 79.1 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:44,866::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:44,872::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:45,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:45,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342255 s, 29.9 MB/s\n'; <rc> = 0 >Thread-776::DEBUG::2014-01-24 19:35:45,512::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-776::INFO::2014-01-24 19:35:45,512::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-776::INFO::2014-01-24 19:35:45,512::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-12::DEBUG::2014-01-24 19:35:46,875::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:46,881::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:47,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:47,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274784 s, 37.3 MB/s\n'; <rc> = 0 >Thread-778::DEBUG::2014-01-24 19:35:47,699::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-778::INFO::2014-01-24 19:35:47,699::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-778::INFO::2014-01-24 19:35:47,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-779::DEBUG::2014-01-24 19:35:47,705::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-779::INFO::2014-01-24 19:35:47,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-779::INFO::2014-01-24 19:35:47,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '134474170368', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:35:48,884::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:48,889::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:49,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-780::INFO::2014-01-24 19:35:49,226::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-780::INFO::2014-01-24 19:35:49,227::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00559322', 'lastCheck': '8.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00432184', 'lastCheck': '5.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:35:49,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339204 s, 30.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:35:50,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:35:50,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00496484 s, 825 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:50,893::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:50,898::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:51,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:51,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277135 s, 36.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:52,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:52,907::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:53,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:53,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252679 s, 40.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:35:53,930::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:35:53,939::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033572 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:54,910::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:54,916::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-784::DEBUG::2014-01-24 19:35:55,521::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-784::INFO::2014-01-24 19:35:55,522::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-784::INFO::2014-01-24 19:35:55,522::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Dummy-233::DEBUG::2014-01-24 19:35:55,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:55,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273013 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:35:56,919::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:56,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:57,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:57,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027535 s, 37.2 MB/s\n'; <rc> = 0 >Thread-785::DEBUG::2014-01-24 19:35:57,752::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-785::INFO::2014-01-24 19:35:57,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-785::INFO::2014-01-24 19:35:57,753::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-786::DEBUG::2014-01-24 19:35:57,758::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-786::INFO::2014-01-24 19:35:57,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-786::INFO::2014-01-24 19:35:57,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133926551552', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:35:58,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:35:58,934::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:35:59,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:35:59,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024062 s, 42.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:00,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:00,758::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0479823 s, 85.4 kB/s\n'; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,837::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 224.736 s, 47.8 MB/s']; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,837::misc::287::Storage.Misc::(validateDDBytes) err: ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 224.736 s, 47.8 MB/s'], size: 10737418240 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,838::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b to /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b DONE >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,848::volume::646::Storage.Volume::(setLegality) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b legality = LEGAL >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,856::image::778::Storage.Image::(copyCollapsed) Finished copying a250db32-9b39-4533-8bc6-926d4ae17535:228f2939-3615-4733-ae3c-fc37390a2d0b -> 464da998-ebd2-46a1-bab0-1c02a21a165e:228f2939-3615-4733-ae3c-fc37390a2d0b >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,856::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b justme False >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,857::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:00,937::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:00,942::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,248::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,248::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,344::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,353::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Dummy-233::DEBUG::2014-01-24 19:36:01,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:01,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266248 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:02,945::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:02,951::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:03,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:03,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273961 s, 37.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:03,947::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:03,953::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000333656 s, 1.0 MB/s\n'; <rc> = 0 >Thread-789::INFO::2014-01-24 19:36:04,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-789::INFO::2014-01-24 19:36:04,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0479823', 'lastCheck': '3.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333656', 'lastCheck': '0.4', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:36:04,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:04,959::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-791::DEBUG::2014-01-24 19:36:05,530::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-791::INFO::2014-01-24 19:36:05,530::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-791::INFO::2014-01-24 19:36:05,530::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}} >Thread-792::DEBUG::2014-01-24 19:36:05,604::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1d54c437] >Thread-792::INFO::2014-01-24 19:36:05,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None) >Thread-792::INFO::2014-01-24 19:36:05,604::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b >Thread-792::DEBUG::2014-01-24 19:36:05,606::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-792::DEBUG::2014-01-24 19:36:05,612::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000888343 s, 576 kB/s\n'; <rc> = 0 >Thread-792::DEBUG::2014-01-24 19:36:05,613::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000888343 s, 576 kB/s'], size: 512 >Thread-792::DEBUG::2014-01-24 19:36:05,615::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-792::DEBUG::2014-01-24 19:36:05,620::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000537701 s, 952 kB/s\n'; <rc> = 0 >Thread-792::DEBUG::2014-01-24 19:36:05,621::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000537701 s, 952 kB/s'], size: 512 >Thread-792::INFO::2014-01-24 19:36:05,621::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-792::INFO::2014-01-24 19:36:05,621::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-793::DEBUG::2014-01-24 19:36:05,695::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-793::INFO::2014-01-24 19:36:05,696::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmList=[{'imglist': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>', 'vm': 'ae133201-adba-4434-a3f0-54e56eeaaa17'}], sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None) >Thread-793::INFO::2014-01-24 19:36:05,697::sp::1273::Storage.StoragePool::(updateVM) spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-793::INFO::2014-01-24 19:36:05,698::sp::1284::Storage.StoragePool::(updateVM) vmUUID=ae133201-adba-4434-a3f0-54e56eeaaa17 imgList=['df30ebf7-0d71-40b0-a33e-07170bdead7d'] >Thread-793::INFO::2014-01-24 19:36:05,701::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-794::DEBUG::2014-01-24 19:36:05,781::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-794::INFO::2014-01-24 19:36:05,781::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='a251d5d0-0f19-4169-8c5d-8f519aa59fa4', spUUID=None, options=None) >Thread-794::INFO::2014-01-24 19:36:05,782::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Dummy-233::DEBUG::2014-01-24 19:36:05,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:05,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273863 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:06,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:06,967::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-796::DEBUG::2014-01-24 19:36:07,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-796::INFO::2014-01-24 19:36:07,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-796::INFO::2014-01-24 19:36:07,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-797::DEBUG::2014-01-24 19:36:07,870::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-797::INFO::2014-01-24 19:36:07,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-797::INFO::2014-01-24 19:36:07,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606604800', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:36:07,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:08,000::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263604 s, 38.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:08,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:08,975::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:10,009::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:10,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272662 s, 37.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:10,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:10,769::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533941 s, 7.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:10,978::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:10,983::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:12,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:12,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247516 s, 41.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:12,986::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:12,991::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:13,960::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:13,966::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000298866 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:14,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:14,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272561 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:14,994::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:14,999::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:16,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:16,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276086 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:17,002::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:17,007::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-801::DEBUG::2014-01-24 19:36:17,912::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-801::INFO::2014-01-24 19:36:17,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-801::INFO::2014-01-24 19:36:17,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-802::DEBUG::2014-01-24 19:36:17,937::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-802::INFO::2014-01-24 19:36:17,938::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-802::INFO::2014-01-24 19:36:17,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:36:18,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:18,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246665 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:19,010::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:19,015::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-803::INFO::2014-01-24 19:36:19,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-803::INFO::2014-01-24 19:36:19,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533941', 'lastCheck': '8.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298866', 'lastCheck': '5.5', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:36:20,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:20,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243544 s, 42.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:20,772::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-120::DEBUG::2014-01-24 19:36:20,772::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:36:20,775::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:20,780::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00053094 s, 3.9 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:20,780::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00053094 s, 3.9 MB/s'], size: 2048 >Thread-120::DEBUG::2014-01-24 19:36:20,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-120::DEBUG::2014-01-24 19:36:20,781::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:36:20,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:21,018::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:21,024::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:22,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:22,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273598 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:23,027::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:23,032::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:23,972::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:23,978::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000357882 s, 956 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:24,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:24,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274671 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:25,035::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:25,040::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:26,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:26,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241761 s, 42.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:27,043::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:27,048::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-807::DEBUG::2014-01-24 19:36:28,002::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-807::INFO::2014-01-24 19:36:28,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Dummy-233::DEBUG::2014-01-24 19:36:28,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:28,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263494 s, 38.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:29,051::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:29,056::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:29,446::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:29,447::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6'] >Thread-120::INFO::2014-01-24 19:36:29,447::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-120::INFO::2014-01-24 19:36:29,447::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-120::INFO::2014-01-24 19:36:29,447::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-807::INFO::2014-01-24 19:36:29,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-120::DEBUG::2014-01-24 19:36:29,450::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-809::DEBUG::2014-01-24 19:36:29,461::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-809::INFO::2014-01-24 19:36:29,462::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-809::INFO::2014-01-24 19:36:29,463::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-120::DEBUG::2014-01-24 19:36:29,555::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:29,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:29,563::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000515568 s, 7.9 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:30,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:30,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275311 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:31,059::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:31,064::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:32,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:32,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249535 s, 41.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:33,067::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:33,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:33,985::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:33,991::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000339503 s, 1.0 MB/s\n'; <rc> = 0 >Thread-811::INFO::2014-01-24 19:36:34,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-811::INFO::2014-01-24 19:36:34,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515568', 'lastCheck': '5.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000339503', 'lastCheck': '0.7', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:36:34,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:34,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272172 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:35,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:35,080::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:36,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:36,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024505 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:37,083::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:37,088::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:38,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:38,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02438 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:39,091::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:39,096::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-814::DEBUG::2014-01-24 19:36:39,543::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [e019bb8] >Thread-814::INFO::2014-01-24 19:36:39,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-814::INFO::2014-01-24 19:36:39,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-815::DEBUG::2014-01-24 19:36:39,549::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [e019bb8] >Thread-815::INFO::2014-01-24 19:36:39,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-815::INFO::2014-01-24 19:36:39,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-120::DEBUG::2014-01-24 19:36:39,582::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:39,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000532419 s, 7.7 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:40,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:40,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273431 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:41,099::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:41,105::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-817::DEBUG::2014-01-24 19:36:41,465::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-817::INFO::2014-01-24 19:36:41,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-817::INFO::2014-01-24 19:36:41,468::sd::582::Storage.StorageDomain::(getVMsList) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17'] >Thread-817::INFO::2014-01-24 19:36:41,468::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17'] >Thread-817::INFO::2014-01-24 19:36:41,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'ae133201-adba-4434-a3f0-54e56eeaaa17': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>'}} >Dummy-233::DEBUG::2014-01-24 19:36:42,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:43,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245187 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:43,107::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:43,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:43,998::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:44,004::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365791 s, 935 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:45,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:45,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244978 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:45,116::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:45,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-819::DEBUG::2014-01-24 19:36:46,380::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7fbb509f] >Thread-819::INFO::2014-01-24 19:36:46,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None) >Thread-819::DEBUG::2014-01-24 19:36:46,381::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-819::DEBUG::2014-01-24 19:36:46,476::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-819::DEBUG::2014-01-24 19:36:46,480::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-819::INFO::2014-01-24 19:36:46,480::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b >Thread-819::DEBUG::2014-01-24 19:36:46,482::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-819::DEBUG::2014-01-24 19:36:46,488::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526967 s, 972 kB/s\n'; <rc> = 0 >Thread-819::DEBUG::2014-01-24 19:36:46,488::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526967 s, 972 kB/s'], size: 512 >Thread-819::DEBUG::2014-01-24 19:36:46,491::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-819::DEBUG::2014-01-24 19:36:46,496::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000527023 s, 971 kB/s\n'; <rc> = 0 >Thread-819::DEBUG::2014-01-24 19:36:46,496::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000527023 s, 971 kB/s'], size: 512 >Thread-819::INFO::2014-01-24 19:36:46,496::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-819::INFO::2014-01-24 19:36:46,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-820::DEBUG::2014-01-24 19:36:46,506::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7fbb509f] >Thread-820::INFO::2014-01-24 19:36:46,506::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None) >Thread-820::INFO::2014-01-24 19:36:46,508::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': ['df30ebf7-0d71-40b0-a33e-07170bdead7d']} >Dummy-233::DEBUG::2014-01-24 19:36:47,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:47,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:47,134::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:47,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481113 s, 21.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:49,146::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:49,151::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:49,180::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:49,232::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262636 s, 39.0 MB/s\n'; <rc> = 0 >Thread-822::DEBUG::2014-01-24 19:36:49,598::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-822::INFO::2014-01-24 19:36:49,598::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-822::INFO::2014-01-24 19:36:49,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-120::DEBUG::2014-01-24 19:36:49,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-823::DEBUG::2014-01-24 19:36:49,624::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-823::INFO::2014-01-24 19:36:49,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-823::INFO::2014-01-24 19:36:49,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-120::DEBUG::2014-01-24 19:36:49,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000560232 s, 7.3 MB/s\n'; <rc> = 0 >Thread-824::INFO::2014-01-24 19:36:49,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-824::INFO::2014-01-24 19:36:49,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560232', 'lastCheck': '0.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365791', 'lastCheck': '5.8', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:36:51,154::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:51,159::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:51,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:51,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271925 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:53,162::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:53,167::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:53,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:53,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269886 s, 37.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:36:54,012::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:36:54,017::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360746 s, 948 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:55,170::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:55,175::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:55,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:55,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274341 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:57,178::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:57,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:57,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:57,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027556 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:36:59,186::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:36:59,192::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:36:59,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:36:59,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241541 s, 42.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:36:59,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:36:59,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580114 s, 7.1 MB/s\n'; <rc> = 0 >Thread-829::DEBUG::2014-01-24 19:36:59,684::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-829::INFO::2014-01-24 19:36:59,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-829::INFO::2014-01-24 19:36:59,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-830::DEBUG::2014-01-24 19:36:59,696::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-830::INFO::2014-01-24 19:36:59,698::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-830::INFO::2014-01-24 19:36:59,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:37:01,195::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:01,200::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:01,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:01,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270262 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:03,203::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:03,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:03,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:03,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272518 s, 37.6 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:04,025::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:04,031::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000363962 s, 940 kB/s\n'; <rc> = 0 >Thread-832::INFO::2014-01-24 19:37:04,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-832::INFO::2014-01-24 19:37:04,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580114', 'lastCheck': '5.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363962', 'lastCheck': '0.9', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:37:05,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:05,216::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:05,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:05,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248569 s, 41.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:07,219::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:07,224::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:07,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:07,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264596 s, 38.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:09,227::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:09,232::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:09,670::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:09,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060092 s, 6.8 MB/s\n'; <rc> = 0 >Thread-835::DEBUG::2014-01-24 19:37:09,761::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-835::INFO::2014-01-24 19:37:09,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-835::INFO::2014-01-24 19:37:09,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-836::DEBUG::2014-01-24 19:37:09,767::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-836::INFO::2014-01-24 19:37:09,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-836::INFO::2014-01-24 19:37:09,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:37:09,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:09,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265933 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:11,235::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:11,240::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:11,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:11,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243976 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:13,243::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:13,248::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:13,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:13,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276857 s, 37.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:14,038::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:14,044::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000389498 s, 878 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:15,251::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:15,256::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:15,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:16,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274438 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:17,259::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:17,266::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:18,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:18,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245983 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:19,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:19,276::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:19,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:19,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558672 s, 7.3 MB/s\n'; <rc> = 0 >Thread-840::DEBUG::2014-01-24 19:37:19,809::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-840::INFO::2014-01-24 19:37:19,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-840::INFO::2014-01-24 19:37:19,810::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-841::DEBUG::2014-01-24 19:37:19,815::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-841::INFO::2014-01-24 19:37:19,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-841::INFO::2014-01-24 19:37:19,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-842::INFO::2014-01-24 19:37:20,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-842::INFO::2014-01-24 19:37:20,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558672', 'lastCheck': '0.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000389498', 'lastCheck': '6.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:37:20,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:20,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309829 s, 33.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:21,279::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:21,284::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:22,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:22,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276866 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:23,287::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:23,292::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:24,051::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:24,057::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000363833 s, 940 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:24,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:24,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271386 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:25,295::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:25,300::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:26,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:26,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284754 s, 36.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:27,303::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:27,308::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:28,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:28,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027065 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:29,311::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:29,316::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:29,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:29,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631127 s, 6.5 MB/s\n'; <rc> = 0 >Thread-847::DEBUG::2014-01-24 19:37:29,861::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-847::INFO::2014-01-24 19:37:29,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-847::INFO::2014-01-24 19:37:29,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-848::DEBUG::2014-01-24 19:37:29,869::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-848::INFO::2014-01-24 19:37:29,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-848::INFO::2014-01-24 19:37:29,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:37:30,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:30,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269839 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:31,319::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:31,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:32,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:32,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241785 s, 42.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:33,327::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:33,333::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:34,064::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:34,070::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000329612 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:34,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:34,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279484 s, 36.6 MB/s\n'; <rc> = 0 >Thread-850::INFO::2014-01-24 19:37:35,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-850::INFO::2014-01-24 19:37:35,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631127', 'lastCheck': '5.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329612', 'lastCheck': '1.2', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:37:35,335::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:35,340::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:36,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:36,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272904 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:37,343::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:37,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:38,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:38,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024797 s, 41.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:39,351::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:39,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:39,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:39,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641443 s, 6.4 MB/s\n'; <rc> = 0 >Thread-853::DEBUG::2014-01-24 19:37:39,916::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-853::INFO::2014-01-24 19:37:39,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-853::INFO::2014-01-24 19:37:39,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-854::DEBUG::2014-01-24 19:37:39,926::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-854::INFO::2014-01-24 19:37:39,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-854::INFO::2014-01-24 19:37:39,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:37:40,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:40,768::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280626 s, 36.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:41,359::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:41,365::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:42,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:42,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244346 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:43,368::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:43,373::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:44,078::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:44,083::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349297 s, 979 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:44,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:44,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247335 s, 41.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:45,376::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:45,381::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:46,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:46,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274122 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:47,384::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:47,389::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:48,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:49,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243752 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:49,391::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:49,397::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:49,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:49,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664177 s, 6.2 MB/s\n'; <rc> = 0 >Thread-858::DEBUG::2014-01-24 19:37:50,003::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-858::INFO::2014-01-24 19:37:50,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-858::INFO::2014-01-24 19:37:50,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-859::DEBUG::2014-01-24 19:37:50,012::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-859::INFO::2014-01-24 19:37:50,012::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-859::INFO::2014-01-24 19:37:50,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-860::INFO::2014-01-24 19:37:50,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-860::INFO::2014-01-24 19:37:50,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664177', 'lastCheck': '0.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349297', 'lastCheck': '6.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:37:51,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:51,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271907 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:51,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:51,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:53,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:53,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027326 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:53,408::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:53,413::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:37:54,090::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:37:54,096::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000346199 s, 988 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:55,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:55,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278249 s, 36.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:55,416::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:55,421::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:57,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:57,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242493 s, 42.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:57,424::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:57,429::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:37:59,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:37:59,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275319 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:37:59,432::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:37:59,437::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:37:59,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:37:59,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630704 s, 6.5 MB/s\n'; <rc> = 0 >Thread-865::DEBUG::2014-01-24 19:38:00,049::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-865::INFO::2014-01-24 19:38:00,049::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-865::INFO::2014-01-24 19:38:00,049::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-866::DEBUG::2014-01-24 19:38:00,055::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-866::INFO::2014-01-24 19:38:00,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-866::INFO::2014-01-24 19:38:00,056::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:38:01,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:01,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266148 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:01,440::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:01,445::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:03,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:03,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243367 s, 42.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:03,448::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:03,453::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:04,104::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:04,110::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000381447 s, 897 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:05,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:05,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:05,468::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:05,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428542 s, 23.9 MB/s\n'; <rc> = 0 >Thread-868::INFO::2014-01-24 19:38:05,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-868::INFO::2014-01-24 19:38:05,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630704', 'lastCheck': '5.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000381447', 'lastCheck': '1.4', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:38:07,488::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:07,493::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:07,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:07,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272851 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:09,496::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:09,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:09,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:09,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027213 s, 37.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:09,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:09,743::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543363 s, 7.5 MB/s\n'; <rc> = 0 >Thread-871::DEBUG::2014-01-24 19:38:10,102::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-871::INFO::2014-01-24 19:38:10,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-871::INFO::2014-01-24 19:38:10,103::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-872::DEBUG::2014-01-24 19:38:10,109::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-872::INFO::2014-01-24 19:38:10,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-872::INFO::2014-01-24 19:38:10,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:38:11,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:11,510::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:11,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:11,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270986 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:13,513::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:13,518::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:13,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:13,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281688 s, 36.4 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:14,118::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:14,124::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00035141 s, 973 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:15,521::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:15,526::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:15,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:15,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275598 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:17,529::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:17,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:17,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:17,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269156 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:19,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:19,542::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:19,753::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:19,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605798 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:19,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:19,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272006 s, 37.6 MB/s\n'; <rc> = 0 >Thread-876::DEBUG::2014-01-24 19:38:20,186::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-876::INFO::2014-01-24 19:38:20,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-876::INFO::2014-01-24 19:38:20,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-877::DEBUG::2014-01-24 19:38:20,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-877::INFO::2014-01-24 19:38:20,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-877::INFO::2014-01-24 19:38:20,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-878::INFO::2014-01-24 19:38:20,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-878::INFO::2014-01-24 19:38:20,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605798', 'lastCheck': '1.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00035141', 'lastCheck': '6.7', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:38:21,545::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:21,550::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:21,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:22,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268826 s, 38.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:23,553::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:23,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:24,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:24,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274673 s, 37.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:24,132::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:24,138::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349118 s, 980 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:25,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:25,566::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:26,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:26,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273312 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:27,569::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:27,574::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:28,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:28,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278026 s, 36.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:29,577::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:29,582::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:29,764::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:29,770::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070243 s, 5.8 MB/s\n'; <rc> = 0 >Thread-883::DEBUG::2014-01-24 19:38:30,235::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-883::INFO::2014-01-24 19:38:30,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-883::INFO::2014-01-24 19:38:30,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-884::DEBUG::2014-01-24 19:38:30,242::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-884::INFO::2014-01-24 19:38:30,243::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-884::INFO::2014-01-24 19:38:30,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:38:30,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:30,306::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027199 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:31,585::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:31,590::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:32,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:32,368::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268551 s, 38.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:33,593::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:33,598::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:34,145::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:34,151::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000316974 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:34,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:34,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276098 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:35,601::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:35,606::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-886::INFO::2014-01-24 19:38:36,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-886::INFO::2014-01-24 19:38:36,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070243', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316974', 'lastCheck': '1.9', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:38:36,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:36,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274134 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:37,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:37,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:38,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:38,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241171 s, 42.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:39,617::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:39,622::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:39,775::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:39,781::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000492875 s, 8.3 MB/s\n'; <rc> = 0 >Thread-889::DEBUG::2014-01-24 19:38:40,296::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-889::INFO::2014-01-24 19:38:40,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-889::INFO::2014-01-24 19:38:40,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-890::DEBUG::2014-01-24 19:38:40,315::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-890::INFO::2014-01-24 19:38:40,315::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-890::INFO::2014-01-24 19:38:40,316::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:38:40,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:40,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273376 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:41,625::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:41,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:42,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:42,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275964 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:43,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:43,639::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:44,159::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:44,164::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328558 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:44,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:44,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244557 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:45,642::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:45,647::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:46,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:46,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267362 s, 38.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:47,650::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:47,655::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:48,804::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:48,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275357 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:49,658::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:49,663::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:49,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:49,791::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577176 s, 7.1 MB/s\n'; <rc> = 0 >Thread-894::DEBUG::2014-01-24 19:38:50,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-894::INFO::2014-01-24 19:38:50,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-894::INFO::2014-01-24 19:38:50,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-895::DEBUG::2014-01-24 19:38:50,360::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-895::INFO::2014-01-24 19:38:50,360::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-895::INFO::2014-01-24 19:38:50,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:38:50,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:50,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272425 s, 37.6 MB/s\n'; <rc> = 0 >Thread-896::INFO::2014-01-24 19:38:51,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-896::INFO::2014-01-24 19:38:51,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577176', 'lastCheck': '1.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328558', 'lastCheck': '7.1', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:38:51,666::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:51,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:52,928::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:52,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026805 s, 38.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:53,674::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:53,679::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:38:54,171::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:38:54,177::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359739 s, 951 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:54,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:55,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272421 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:55,682::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:55,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:57,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:57,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245317 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:57,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:57,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:38:59,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:38:59,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272791 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:38:59,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:38:59,703::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:38:59,796::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:38:59,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660085 s, 6.2 MB/s\n'; <rc> = 0 >Thread-900::DEBUG::2014-01-24 19:39:00,404::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-900::INFO::2014-01-24 19:39:00,405::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-900::INFO::2014-01-24 19:39:00,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-902::DEBUG::2014-01-24 19:39:00,430::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-902::INFO::2014-01-24 19:39:00,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-902::INFO::2014-01-24 19:39:00,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:39:01,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:01,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272066 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:01,706::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:01,711::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:03,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:03,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243958 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:03,714::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:03,719::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:04,185::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:04,191::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000306043 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:05,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:05,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286934 s, 35.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:05,722::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:05,727::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-904::INFO::2014-01-24 19:39:06,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-904::INFO::2014-01-24 19:39:06,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660085', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306043', 'lastCheck': '2.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:39:07,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:07,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027208 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:07,730::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:07,735::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:09,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:09,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246578 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:09,738::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:09,743::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:09,807::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:09,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609725 s, 6.7 MB/s\n'; <rc> = 0 >Thread-907::DEBUG::2014-01-24 19:39:10,499::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-907::INFO::2014-01-24 19:39:10,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-907::INFO::2014-01-24 19:39:10,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-908::DEBUG::2014-01-24 19:39:10,526::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-908::INFO::2014-01-24 19:39:10,526::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-908::INFO::2014-01-24 19:39:10,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:39:11,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:11,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244842 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:11,746::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:11,751::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:13,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:13,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267265 s, 38.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:13,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:13,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:14,198::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:14,203::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325898 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:15,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:15,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241837 s, 42.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:15,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:15,770::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:17,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:17,707::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245063 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:17,774::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:17,779::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:19,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:19,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275957 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:19,782::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:19,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:19,818::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:19,824::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590926 s, 6.9 MB/s\n'; <rc> = 0 >Thread-912::DEBUG::2014-01-24 19:39:20,579::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-912::INFO::2014-01-24 19:39:20,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-912::INFO::2014-01-24 19:39:20,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-913::DEBUG::2014-01-24 19:39:20,585::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-913::INFO::2014-01-24 19:39:20,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-913::INFO::2014-01-24 19:39:20,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-914::INFO::2014-01-24 19:39:21,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-914::INFO::2014-01-24 19:39:21,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590926', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325898', 'lastCheck': '7.4', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:39:21,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:21,790::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:21,800::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:21,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445552 s, 23.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:23,813::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:23,818::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:23,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:23,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271866 s, 37.7 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:24,211::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:24,217::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000341368 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:25,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:25,826::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:25,920::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:25,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271592 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:27,829::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:27,834::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:27,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:28,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273592 s, 37.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:29,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:29,835::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634346 s, 6.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:29,837::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:29,849::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:30,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:30,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137247 s, 7.5 MB/s\n'; <rc> = 0 >Thread-918::DEBUG::2014-01-24 19:39:30,626::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-918::INFO::2014-01-24 19:39:30,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-918::INFO::2014-01-24 19:39:30,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-919::DEBUG::2014-01-24 19:39:30,631::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-919::INFO::2014-01-24 19:39:30,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-919::INFO::2014-01-24 19:39:30,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:39:31,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:31,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:32,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:32,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270177 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:33,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:33,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:34,224::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:34,230::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365617 s, 935 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:34,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:34,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027297 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:35,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:35,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:36,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:36,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271713 s, 37.7 MB/s\n'; <rc> = 0 >Thread-922::INFO::2014-01-24 19:39:36,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-922::INFO::2014-01-24 19:39:36,744::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634346', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365617', 'lastCheck': '2.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:39:37,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:37,886::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:38,420::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:38,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275939 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:39,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:39,863::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070477 s, 5.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:39,889::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:39,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:40,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:40,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272676 s, 37.6 MB/s\n'; <rc> = 0 >Thread-925::DEBUG::2014-01-24 19:39:40,677::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-925::INFO::2014-01-24 19:39:40,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-925::INFO::2014-01-24 19:39:40,678::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-926::DEBUG::2014-01-24 19:39:40,684::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-926::INFO::2014-01-24 19:39:40,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-926::INFO::2014-01-24 19:39:40,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:39:41,897::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:41,902::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:42,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:42,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271432 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:43,905::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:43,910::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:44,238::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:44,244::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000385842 s, 886 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:44,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:44,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239729 s, 42.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:45,913::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:45,918::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:46,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:46,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274962 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:47,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:47,926::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:48,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:48,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027076 s, 37.8 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:49,869::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:49,875::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063001 s, 6.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:49,929::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:49,934::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-930::DEBUG::2014-01-24 19:39:50,765::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-930::INFO::2014-01-24 19:39:50,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-930::INFO::2014-01-24 19:39:50,765::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-931::DEBUG::2014-01-24 19:39:50,771::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-931::INFO::2014-01-24 19:39:50,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-931::INFO::2014-01-24 19:39:50,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:39:50,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:50,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242643 s, 42.2 MB/s\n'; <rc> = 0 >Thread-932::INFO::2014-01-24 19:39:51,871::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-932::INFO::2014-01-24 19:39:51,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063001', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385842', 'lastCheck': '7.6', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:39:51,937::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:51,942::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:52,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:52,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270151 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:53,945::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:53,950::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:39:54,251::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:39:54,257::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000344865 s, 992 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:54,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:54,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027491 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:55,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:55,958::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:56,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:57,021::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244559 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:57,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:57,966::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:39:59,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:39:59,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273744 s, 37.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:39:59,880::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:39:59,886::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629782 s, 6.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:39:59,969::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:39:59,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-936::DEBUG::2014-01-24 19:40:00,856::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-936::INFO::2014-01-24 19:40:00,856::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-936::INFO::2014-01-24 19:40:00,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-937::DEBUG::2014-01-24 19:40:00,862::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-937::INFO::2014-01-24 19:40:00,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-937::INFO::2014-01-24 19:40:00,863::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:40:01,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:01,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270715 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:01,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:01,986::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:03,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:03,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246184 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:03,991::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:03,996::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:04,265::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:04,270::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000383929 s, 891 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:05,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:05,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274919 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:05,999::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:06,004::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-940::INFO::2014-01-24 19:40:07,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-940::INFO::2014-01-24 19:40:07,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629782', 'lastCheck': '7.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000383929', 'lastCheck': '2.8', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:40:07,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:07,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272274 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:08,007::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:08,012::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:09,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:09,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246792 s, 41.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:09,891::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:09,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638803 s, 6.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:10,015::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:10,020::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-943::DEBUG::2014-01-24 19:40:10,968::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-943::INFO::2014-01-24 19:40:10,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-943::INFO::2014-01-24 19:40:10,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-944::DEBUG::2014-01-24 19:40:11,013::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-944::INFO::2014-01-24 19:40:11,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-944::INFO::2014-01-24 19:40:11,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:40:11,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:11,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02749 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:12,023::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:12,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:13,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:13,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027465 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:14,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:14,036::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:14,278::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:14,284::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000330447 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:15,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:15,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246125 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:16,039::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:16,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:17,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:17,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246708 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:18,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:18,052::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:19,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:19,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027521 s, 37.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:19,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:19,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603117 s, 6.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:20,054::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:20,059::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-948::DEBUG::2014-01-24 19:40:21,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-948::INFO::2014-01-24 19:40:21,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-948::INFO::2014-01-24 19:40:21,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-949::DEBUG::2014-01-24 19:40:21,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-949::INFO::2014-01-24 19:40:21,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-949::INFO::2014-01-24 19:40:21,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:40:21,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:21,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271565 s, 37.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:22,062::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:22,067::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-950::INFO::2014-01-24 19:40:22,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-950::INFO::2014-01-24 19:40:22,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603117', 'lastCheck': '2.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330447', 'lastCheck': '7.9', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:40:23,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:23,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245836 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:24,070::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:24,075::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:24,291::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:24,297::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000364508 s, 938 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:25,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:25,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275932 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:26,078::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:26,084::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:27,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:27,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251263 s, 40.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:28,087::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:28,092::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:29,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:29,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655046 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:29,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:29,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273382 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:30,095::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:30,100::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-954::DEBUG::2014-01-24 19:40:31,215::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-954::INFO::2014-01-24 19:40:31,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-954::INFO::2014-01-24 19:40:31,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-955::DEBUG::2014-01-24 19:40:31,260::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-955::INFO::2014-01-24 19:40:31,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-955::INFO::2014-01-24 19:40:31,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:40:32,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:32,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027612 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:32,103::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:32,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:34,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:34,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:34,122::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:34,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244125 s, 41.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:34,304::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:34,310::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000350332 s, 976 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:36,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:36,137::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:36,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:36,199::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271121 s, 37.8 MB/s\n'; <rc> = 0 >Thread-958::INFO::2014-01-24 19:40:37,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-958::INFO::2014-01-24 19:40:37,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655046', 'lastCheck': '7.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350332', 'lastCheck': '3.1', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:40:38,141::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:38,146::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:38,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:38,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027305 s, 37.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:39,924::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:39,930::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583751 s, 7.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:40,149::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:40,154::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:40,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:40,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275515 s, 37.2 MB/s\n'; <rc> = 0 >Thread-961::DEBUG::2014-01-24 19:40:41,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-961::INFO::2014-01-24 19:40:41,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-961::INFO::2014-01-24 19:40:41,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-962::DEBUG::2014-01-24 19:40:41,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-962::INFO::2014-01-24 19:40:41,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-962::INFO::2014-01-24 19:40:41,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:40:42,156::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:42,161::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:42,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:42,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275731 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:44,164::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:44,169::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:44,311::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:40:44,315::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e >Thread-363::DEBUG::2014-01-24 19:40:44,316::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-363::DEBUG::2014-01-24 19:40:44,320::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc'] >Thread-363::DEBUG::2014-01-24 19:40:44,321::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-363::INFO::2014-01-24 19:40:44,321::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered >Thread-363::INFO::2014-01-24 19:40:44,322::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered >Thread-363::DEBUG::2014-01-24 19:40:44,328::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:44,334::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359536 s, 951 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:44,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:44,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027408 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:46,172::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:46,177::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:46,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:46,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273454 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:48,180::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:48,185::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:48,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:48,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275773 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:49,936::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:49,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622773 s, 6.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:50,188::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:50,193::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:50,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:50,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243134 s, 42.1 MB/s\n'; <rc> = 0 >Thread-967::DEBUG::2014-01-24 19:40:51,486::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-967::INFO::2014-01-24 19:40:51,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-967::INFO::2014-01-24 19:40:51,487::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-968::DEBUG::2014-01-24 19:40:51,492::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-968::INFO::2014-01-24 19:40:51,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-968::INFO::2014-01-24 19:40:51,494::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:40:52,196::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:52,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-969::INFO::2014-01-24 19:40:52,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-969::INFO::2014-01-24 19:40:52,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622773', 'lastCheck': '2.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359536', 'lastCheck': '8.2', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:40:52,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:52,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274633 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:54,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:54,209::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:40:54,341::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:40:54,347::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325108 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:54,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:54,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272861 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:56,212::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:56,217::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:56,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:56,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245861 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:40:58,220::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:40:58,225::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:40:58,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:40:58,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274494 s, 37.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:40:59,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:40:59,953::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641755 s, 6.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:00,228::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:00,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:00,883::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:00,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276723 s, 37.0 MB/s\n'; <rc> = 0 >Thread-973::DEBUG::2014-01-24 19:41:01,539::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-973::INFO::2014-01-24 19:41:01,539::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-973::INFO::2014-01-24 19:41:01,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-974::DEBUG::2014-01-24 19:41:01,545::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-974::INFO::2014-01-24 19:41:01,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-974::INFO::2014-01-24 19:41:01,546::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:41:02,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:02,241::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:02,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:02,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246942 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:04,244::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:04,249::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:41:04,354::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:04,360::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349686 s, 978 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:05,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:05,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272341 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:06,252::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:06,257::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:07,065::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:07,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272264 s, 37.6 MB/s\n'; <rc> = 0 >Thread-977::INFO::2014-01-24 19:41:07,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-977::INFO::2014-01-24 19:41:07,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641755', 'lastCheck': '7.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349686', 'lastCheck': '3.3', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:41:08,260::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:08,265::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:09,127::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:09,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246261 s, 41.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:09,958::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:41:09,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622794 s, 6.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:10,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:10,273::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:11,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:11,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273657 s, 37.4 MB/s\n'; <rc> = 0 >Thread-980::DEBUG::2014-01-24 19:41:11,593::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-980::INFO::2014-01-24 19:41:11,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-980::INFO::2014-01-24 19:41:11,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-981::DEBUG::2014-01-24 19:41:11,598::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-981::INFO::2014-01-24 19:41:11,598::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-981::INFO::2014-01-24 19:41:11,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:41:12,276::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:12,281::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:13,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:13,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275421 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:14,284::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:14,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:41:14,367::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:14,373::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000403669 s, 847 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:15,310::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:15,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246709 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:16,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:16,297::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:17,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:17,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273387 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:18,300::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:18,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:19,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:19,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027182 s, 37.7 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:19,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:41:19,975::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649727 s, 6.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:20,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:20,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:21,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:21,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273221 s, 37.5 MB/s\n'; <rc> = 0 >Thread-985::DEBUG::2014-01-24 19:41:21,637::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-985::INFO::2014-01-24 19:41:21,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-985::INFO::2014-01-24 19:41:21,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-986::DEBUG::2014-01-24 19:41:21,644::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-986::INFO::2014-01-24 19:41:21,644::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-986::INFO::2014-01-24 19:41:21,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:41:22,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:22,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-987::INFO::2014-01-24 19:41:22,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-987::INFO::2014-01-24 19:41:22,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649727', 'lastCheck': '2.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403669', 'lastCheck': '8.5', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:41:23,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:23,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269149 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:24,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:24,329::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:41:24,380::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:24,386::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000355317 s, 963 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:25,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:25,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274114 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:26,332::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:26,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:27,676::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:27,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245101 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:28,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:28,345::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:29,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:29,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024117 s, 42.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:29,978::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535 >Thread-120::DEBUG::2014-01-24 19:41:29,979::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:41:29,981::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:41:29,986::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000611524 s, 3.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:29,987::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000611524 s, 3.3 MB/s'], size: 2048 >Thread-120::DEBUG::2014-01-24 19:41:29,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709'] >Thread-120::DEBUG::2014-01-24 19:41:29,987::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-120::DEBUG::2014-01-24 19:41:29,988::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:30,348::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:30,360::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-991::DEBUG::2014-01-24 19:41:31,775::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-991::INFO::2014-01-24 19:41:31,775::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Dummy-233::DEBUG::2014-01-24 19:41:31,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:31,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273601 s, 37.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:32,288::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:32,289::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6'] >Thread-120::INFO::2014-01-24 19:41:32,290::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered >Thread-120::INFO::2014-01-24 19:41:32,290::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered >Thread-120::INFO::2014-01-24 19:41:32,290::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered >Thread-991::INFO::2014-01-24 19:41:32,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-120::DEBUG::2014-01-24 19:41:32,292::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-993::DEBUG::2014-01-24 19:41:32,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-993::INFO::2014-01-24 19:41:32,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-993::INFO::2014-01-24 19:41:32,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:41:32,363::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:32,369::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:32,393::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:32,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:41:32,402::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688153 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:33,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:33,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244342 s, 41.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:34,373::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:34,378::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:41:34,393::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:34,399::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000326777 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:35,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:35,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244015 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:36,381::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:36,387::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:37,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:38,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274226 s, 37.3 MB/s\n'; <rc> = 0 >Thread-995::INFO::2014-01-24 19:41:38,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-995::INFO::2014-01-24 19:41:38,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688153', 'lastCheck': '5.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000326777', 'lastCheck': '3.7', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:41:38,389::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:38,395::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:40,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:40,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242862 s, 42.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:40,397::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:40,403::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:42,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:42,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248994 s, 41.1 MB/s\n'; <rc> = 0 >Thread-998::DEBUG::2014-01-24 19:41:42,355::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-998::INFO::2014-01-24 19:41:42,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-998::INFO::2014-01-24 19:41:42,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-999::DEBUG::2014-01-24 19:41:42,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-999::INFO::2014-01-24 19:41:42,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-999::INFO::2014-01-24 19:41:42,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:41:42,406::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:42,418::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:42,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:41:42,438::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568881 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:44,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:44,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268358 s, 38.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:41:44,407::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:44,413::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000366322 s, 934 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:44,438::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:44,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:46,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:46,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274653 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:46,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:46,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:48,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:48,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248183 s, 41.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:48,454::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:48,459::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:50,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:50,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277097 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:50,462::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:50,467::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:52,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1003::DEBUG::2014-01-24 19:41:52,425::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1003::INFO::2014-01-24 19:41:52,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1003::INFO::2014-01-24 19:41:52,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1004::DEBUG::2014-01-24 19:41:52,437::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1004::INFO::2014-01-24 19:41:52,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1004::INFO::2014-01-24 19:41:52,448::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-120::DEBUG::2014-01-24 19:41:52,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:52,470::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:52,486::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:41:52,490::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558263 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:52,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109037 s, 9.4 MB/s\n'; <rc> = 0 >Thread-1005::INFO::2014-01-24 19:41:53,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1005::INFO::2014-01-24 19:41:53,318::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558263', 'lastCheck': '0.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366322', 'lastCheck': '8.9', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:41:54,419::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:41:54,425::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000347995 s, 983 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:54,507::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:54,512::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:54,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:54,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280212 s, 36.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:56,515::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:56,520::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:56,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:56,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271249 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:41:58,523::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:41:58,528::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:41:58,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:41:58,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276093 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:00,531::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:00,536::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:00,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:00,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276651 s, 37.0 MB/s\n'; <rc> = 0 >Thread-1010::DEBUG::2014-01-24 19:42:02,501::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1010::INFO::2014-01-24 19:42:02,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1010::INFO::2014-01-24 19:42:02,501::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1011::DEBUG::2014-01-24 19:42:02,510::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1011::INFO::2014-01-24 19:42:02,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1011::INFO::2014-01-24 19:42:02,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-120::DEBUG::2014-01-24 19:42:02,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:02,522::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588175 s, 7.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:02,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:02,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:02,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:02,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024776 s, 41.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:42:04,433::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:04,439::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034872 s, 981 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:04,550::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:04,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:04,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:04,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279124 s, 36.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:06,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:06,563::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:06,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:06,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280624 s, 36.5 MB/s\n'; <rc> = 0 >Thread-1013::INFO::2014-01-24 19:42:08,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1013::INFO::2014-01-24 19:42:08,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588175', 'lastCheck': '5.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034872', 'lastCheck': '4.0', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:42:08,566::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:08,571::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:08,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:09,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245991 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:10,574::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:10,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:11,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:11,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275652 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:42:12,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:12,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623456 s, 6.6 MB/s\n'; <rc> = 0 >Thread-1016::DEBUG::2014-01-24 19:42:12,556::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1016::INFO::2014-01-24 19:42:12,556::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1016::INFO::2014-01-24 19:42:12,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1017::DEBUG::2014-01-24 19:42:12,562::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1017::INFO::2014-01-24 19:42:12,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1017::INFO::2014-01-24 19:42:12,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:42:12,594::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:12,599::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:13,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:13,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275288 s, 37.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:42:14,446::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:14,452::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000385124 s, 888 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:14,602::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:14,607::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:15,153::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:15,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247453 s, 41.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:16,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:16,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:17,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:17,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273066 s, 37.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:18,617::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:18,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:19,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:19,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273594 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:20,625::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:20,631::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:21,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:21,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269247 s, 38.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:42:22,538::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:22,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627888 s, 6.5 MB/s\n'; <rc> = 0 >Thread-1021::DEBUG::2014-01-24 19:42:22,600::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1021::INFO::2014-01-24 19:42:22,600::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1021::INFO::2014-01-24 19:42:22,600::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1022::DEBUG::2014-01-24 19:42:22,605::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1022::INFO::2014-01-24 19:42:22,606::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1022::INFO::2014-01-24 19:42:22,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-12::DEBUG::2014-01-24 19:42:22,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:22,638::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:23,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:23,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273384 s, 37.5 MB/s\n'; <rc> = 0 >Thread-1023::INFO::2014-01-24 19:42:23,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1023::INFO::2014-01-24 19:42:23,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627888', 'lastCheck': '1.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385124', 'lastCheck': '9.2', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:42:24,459::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:24,464::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000371354 s, 921 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:24,641::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:24,646::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:25,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:25,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274461 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:26,649::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:26,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:27,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:27,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246515 s, 41.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:28,657::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:28,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:29,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:29,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027684 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:30,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:30,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:31,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:31,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276718 s, 37.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:42:32,549::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:32,555::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588921 s, 7.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:32,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:32,678::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1027::DEBUG::2014-01-24 19:42:32,697::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1027::INFO::2014-01-24 19:42:32,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1027::INFO::2014-01-24 19:42:32,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1028::DEBUG::2014-01-24 19:42:32,725::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1028::INFO::2014-01-24 19:42:32,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1028::INFO::2014-01-24 19:42:32,727::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:42:33,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:33,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247712 s, 41.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:42:34,472::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:34,478::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033562 s, 1.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:34,681::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:34,686::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:35,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:35,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245045 s, 41.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:36,689::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:36,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:37,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:37,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027595 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:38,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:38,702::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1031::INFO::2014-01-24 19:42:38,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1031::INFO::2014-01-24 19:42:38,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588921', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033562', 'lastCheck': '4.3', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:42:39,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:39,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276822 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:40,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:40,710::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:41,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:41,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244799 s, 41.8 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:42:42,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:42,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635942 s, 6.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:42,713::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:42,718::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1034::DEBUG::2014-01-24 19:42:42,783::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1034::INFO::2014-01-24 19:42:42,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1034::INFO::2014-01-24 19:42:42,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1035::DEBUG::2014-01-24 19:42:42,789::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1035::INFO::2014-01-24 19:42:42,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1035::INFO::2014-01-24 19:42:42,790::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:42:44,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:44,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274856 s, 37.3 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:42:44,486::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:44,492::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000372165 s, 919 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:44,721::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:44,726::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:46,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:46,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273912 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:46,729::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:46,734::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:48,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:48,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245938 s, 41.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:48,737::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:48,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:50,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:50,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027224 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:50,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:50,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:52,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:52,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272288 s, 37.6 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:42:52,572::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:42:52,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562773 s, 7.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:52,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:52,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1039::DEBUG::2014-01-24 19:42:52,827::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1039::INFO::2014-01-24 19:42:52,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1039::INFO::2014-01-24 19:42:52,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1040::DEBUG::2014-01-24 19:42:52,833::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1040::INFO::2014-01-24 19:42:52,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1040::INFO::2014-01-24 19:42:52,834::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-1041::INFO::2014-01-24 19:42:53,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1041::INFO::2014-01-24 19:42:53,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562773', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372165', 'lastCheck': '9.4', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:42:54,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:54,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244598 s, 41.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:42:54,499::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:42:54,505::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360605 s, 948 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:54,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:54,766::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:56,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:56,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276026 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:56,769::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:56,774::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:42:58,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:42:58,488::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272508 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:42:58,777::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:42:58,783::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:00,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:00,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245411 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:00,786::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:00,791::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:02,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:02,597::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:02,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635807 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:02,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653964 s, 15.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:02,793::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:02,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1045::DEBUG::2014-01-24 19:43:02,915::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1045::INFO::2014-01-24 19:43:02,916::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1045::INFO::2014-01-24 19:43:02,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1046::DEBUG::2014-01-24 19:43:02,921::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1046::INFO::2014-01-24 19:43:02,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1046::INFO::2014-01-24 19:43:02,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-363::DEBUG::2014-01-24 19:43:04,512::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:04,518::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000344368 s, 993 kB/s\n'; <rc> = 0 >Thread-1048::DEBUG::2014-01-24 19:43:04,635::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1048::INFO::2014-01-24 19:43:04,636::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None) >Thread-1048::INFO::2014-01-24 19:43:04,638::sd::582::Storage.StorageDomain::(getVMsList) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17'] >Thread-1048::INFO::2014-01-24 19:43:04,638::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17'] >Thread-1048::INFO::2014-01-24 19:43:04,640::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'ae133201-adba-4434-a3f0-54e56eeaaa17': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>'}} >Dummy-233::DEBUG::2014-01-24 19:43:04,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:04,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276123 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:04,801::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:04,807::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:06,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:06,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270851 s, 37.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:06,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:06,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1050::DEBUG::2014-01-24 19:43:07,943::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [75bf74bf] >Thread-1050::INFO::2014-01-24 19:43:07,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None) >Thread-1050::DEBUG::2014-01-24 19:43:07,945::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None) >Thread-1050::DEBUG::2014-01-24 19:43:08,038::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1050::DEBUG::2014-01-24 19:43:08,043::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-1050::INFO::2014-01-24 19:43:08,044::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b >Thread-1050::DEBUG::2014-01-24 19:43:08,046::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-1050::DEBUG::2014-01-24 19:43:08,051::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000566781 s, 903 kB/s\n'; <rc> = 0 >Thread-1050::DEBUG::2014-01-24 19:43:08,052::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000566781 s, 903 kB/s'], size: 512 >Thread-1050::DEBUG::2014-01-24 19:43:08,054::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None) >Thread-1050::DEBUG::2014-01-24 19:43:08,059::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000547561 s, 935 kB/s\n'; <rc> = 0 >Thread-1050::DEBUG::2014-01-24 19:43:08,060::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000547561 s, 935 kB/s'], size: 512 >Thread-1050::INFO::2014-01-24 19:43:08,060::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'} >Thread-1050::INFO::2014-01-24 19:43:08,060::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}} >Thread-1051::DEBUG::2014-01-24 19:43:08,111::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [75bf74bf] >Thread-1051::INFO::2014-01-24 19:43:08,111::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None) >Thread-1051::INFO::2014-01-24 19:43:08,114::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': ['df30ebf7-0d71-40b0-a33e-07170bdead7d']} >Dummy-233::DEBUG::2014-01-24 19:43:08,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:08,818::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:08,829::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:08,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241903 s, 42.3 MB/s\n'; <rc> = 0 >Thread-1052::INFO::2014-01-24 19:43:08,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1052::INFO::2014-01-24 19:43:08,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635807', 'lastCheck': '6.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344368', 'lastCheck': '4.5', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:43:10,842::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:10,847::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:10,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:10,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027132 s, 37.7 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:43:12,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:12,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622275 s, 6.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:12,850::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:12,854::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:12,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-1055::DEBUG::2014-01-24 19:43:12,970::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1055::INFO::2014-01-24 19:43:12,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1055::INFO::2014-01-24 19:43:12,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1056::DEBUG::2014-01-24 19:43:12,982::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1056::INFO::2014-01-24 19:43:12,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1056::INFO::2014-01-24 19:43:12,990::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:43:12,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275382 s, 37.2 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:43:14,525::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:14,531::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000376059 s, 909 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:14,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:14,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:15,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:15,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269876 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:16,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:16,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:17,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:17,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275511 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:18,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:18,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:19,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:19,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273692 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:20,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:20,886::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:21,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:21,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02755 s, 37.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:43:22,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:22,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635733 s, 6.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:22,889::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:22,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1060::DEBUG::2014-01-24 19:43:23,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1060::INFO::2014-01-24 19:43:23,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1060::INFO::2014-01-24 19:43:23,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1061::DEBUG::2014-01-24 19:43:23,070::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1061::INFO::2014-01-24 19:43:23,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1061::INFO::2014-01-24 19:43:23,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:43:23,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:23,308::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273806 s, 37.4 MB/s\n'; <rc> = 0 >Thread-1062::INFO::2014-01-24 19:43:24,111::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1062::INFO::2014-01-24 19:43:24,111::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635733', 'lastCheck': '1.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000376059', 'lastCheck': '9.6', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:43:24,538::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:24,543::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365822 s, 935 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:24,897::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:24,901::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:25,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:25,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273835 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:26,904::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:26,909::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:27,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:27,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275513 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:28,912::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:28,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:29,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:29,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276834 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:30,920::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:30,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:31,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:31,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274026 s, 37.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:43:32,647::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:32,653::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525087 s, 7.8 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:32,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:32,933::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1066::DEBUG::2014-01-24 19:43:33,134::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1066::INFO::2014-01-24 19:43:33,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1066::INFO::2014-01-24 19:43:33,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1067::DEBUG::2014-01-24 19:43:33,140::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1067::INFO::2014-01-24 19:43:33,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1067::INFO::2014-01-24 19:43:33,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:43:33,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:33,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269017 s, 38.1 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:43:34,551::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:34,557::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365346 s, 936 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:34,936::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:34,941::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:35,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:35,681::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270447 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:36,944::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:36,949::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:37,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:37,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272001 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:38,952::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:38,957::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1070::INFO::2014-01-24 19:43:39,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1070::INFO::2014-01-24 19:43:39,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525087', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365346', 'lastCheck': '4.7', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:43:39,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:39,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265146 s, 38.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:40,960::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:40,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:41,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:41,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248992 s, 41.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:43:42,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:42,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553592 s, 7.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:42,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:42,973::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1073::DEBUG::2014-01-24 19:43:43,177::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1073::INFO::2014-01-24 19:43:43,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1073::INFO::2014-01-24 19:43:43,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1074::DEBUG::2014-01-24 19:43:43,183::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1074::INFO::2014-01-24 19:43:43,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1074::INFO::2014-01-24 19:43:43,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:43:43,874::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:43,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273199 s, 37.5 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:43:44,565::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:44,571::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000355665 s, 962 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:44,976::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:44,981::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:45,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:45,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270519 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:46,984::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:46,989::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:47,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:48,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243846 s, 42.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:48,992::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:48,997::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:50,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:50,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275291 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:51,000::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:51,005::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:52,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:52,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273181 s, 37.5 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:43:52,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:43:52,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578424 s, 7.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:53,008::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:53,013::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1078::DEBUG::2014-01-24 19:43:53,298::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1078::INFO::2014-01-24 19:43:53,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1078::INFO::2014-01-24 19:43:53,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1079::DEBUG::2014-01-24 19:43:53,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1079::INFO::2014-01-24 19:43:53,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1079::INFO::2014-01-24 19:43:53,305::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:43:54,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:54,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247022 s, 41.5 MB/s\n'; <rc> = 0 >Thread-1080::INFO::2014-01-24 19:43:54,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1080::INFO::2014-01-24 19:43:54,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578424', 'lastCheck': '1.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000355665', 'lastCheck': '9.9', 'valid': True}} >Thread-363::DEBUG::2014-01-24 19:43:54,578::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:43:54,584::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360371 s, 949 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:55,015::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:55,020::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:56,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:56,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275308 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:57,023::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:57,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:43:58,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:43:58,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027713 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:43:59,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:43:59,036::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:00,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:00,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231807 s, 44.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:01,039::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:01,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:02,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:02,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276118 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:02,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:02,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571569 s, 7.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:03,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:03,052::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1084::DEBUG::2014-01-24 19:44:03,344::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1084::INFO::2014-01-24 19:44:03,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1084::INFO::2014-01-24 19:44:03,344::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1085::DEBUG::2014-01-24 19:44:03,350::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1085::INFO::2014-01-24 19:44:03,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1085::INFO::2014-01-24 19:44:03,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:44:04,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:04,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270505 s, 37.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:44:04,591::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:04,597::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359467 s, 951 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:05,055::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:05,060::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:06,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:06,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261901 s, 39.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:07,062::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:07,067::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:08,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:08,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272598 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:09,070::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:09,075::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1088::INFO::2014-01-24 19:44:09,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1088::INFO::2014-01-24 19:44:09,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571569', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359467', 'lastCheck': '5.0', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:44:10,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:10,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275988 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:11,078::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:11,083::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:12,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:12,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629423 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:12,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:12,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273527 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:13,086::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:13,091::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1091::DEBUG::2014-01-24 19:44:13,389::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1091::INFO::2014-01-24 19:44:13,389::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1091::INFO::2014-01-24 19:44:13,389::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1092::DEBUG::2014-01-24 19:44:13,402::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1092::INFO::2014-01-24 19:44:13,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1092::INFO::2014-01-24 19:44:13,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-363::DEBUG::2014-01-24 19:44:14,604::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:14,610::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000351556 s, 973 kB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:14,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:14,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247643 s, 41.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:15,094::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:15,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:16,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:16,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272196 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:17,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:17,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:18,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:18,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248144 s, 41.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:19,110::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:19,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:20,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:21,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232232 s, 44.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:21,118::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:21,123::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:22,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:22,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685818 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:23,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:23,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276959 s, 37.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:23,126::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:23,131::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1096::DEBUG::2014-01-24 19:44:23,463::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1096::INFO::2014-01-24 19:44:23,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1096::INFO::2014-01-24 19:44:23,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1097::DEBUG::2014-01-24 19:44:23,469::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1097::INFO::2014-01-24 19:44:23,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1097::INFO::2014-01-24 19:44:23,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-363::DEBUG::2014-01-24 19:44:24,617::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:24,622::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000398081 s, 859 kB/s\n'; <rc> = 0 >Thread-1098::INFO::2014-01-24 19:44:24,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1098::INFO::2014-01-24 19:44:24,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685818', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000398081', 'lastCheck': '0.1', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:44:25,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:25,135::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:25,145::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:25,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272052 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:27,158::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:27,163::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:27,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:27,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272552 s, 37.6 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:29,166::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:29,171::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:29,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:29,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273439 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:31,174::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:31,179::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:31,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:31,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274095 s, 37.4 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:32,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:32,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000499367 s, 8.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:33,182::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:33,187::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:33,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:33,416::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269825 s, 38.0 MB/s\n'; <rc> = 0 >Thread-1102::DEBUG::2014-01-24 19:44:33,529::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1102::INFO::2014-01-24 19:44:33,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1102::INFO::2014-01-24 19:44:33,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1103::DEBUG::2014-01-24 19:44:33,535::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1103::INFO::2014-01-24 19:44:33,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1103::INFO::2014-01-24 19:44:33,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Thread-363::DEBUG::2014-01-24 19:44:34,631::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:34,641::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000390616 s, 876 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:35,190::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:35,195::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:35,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:35,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273689 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:37,198::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:37,203::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:37,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:37,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269753 s, 38.0 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:39,206::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:39,211::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:39,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:39,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276493 s, 37.0 MB/s\n'; <rc> = 0 >Thread-1106::INFO::2014-01-24 19:44:39,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1106::INFO::2014-01-24 19:44:39,847::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499367', 'lastCheck': '7.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000390616', 'lastCheck': '5.2', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:44:41,214::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:41,219::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:41,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:41,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261009 s, 39.2 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:42,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:42,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000472447 s, 8.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:43,222::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:43,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1109::DEBUG::2014-01-24 19:44:43,576::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1109::INFO::2014-01-24 19:44:43,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1109::INFO::2014-01-24 19:44:43,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1110::DEBUG::2014-01-24 19:44:43,582::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1110::INFO::2014-01-24 19:44:43,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1110::INFO::2014-01-24 19:44:43,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:44:43,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:43,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277316 s, 36.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:44:44,649::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:44,655::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349621 s, 978 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:45,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:45,234::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:45,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:45,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027612 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:47,237::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:47,242::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:47,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:47,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265737 s, 38.5 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:49,245::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:49,250::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:49,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:49,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273552 s, 37.4 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:51,253::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:51,258::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:51,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:51,976::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276324 s, 37.1 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:44:52,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:44:52,743::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594908 s, 6.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:53,261::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:53,266::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1114::DEBUG::2014-01-24 19:44:53,648::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1114::INFO::2014-01-24 19:44:53,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1114::INFO::2014-01-24 19:44:53,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1115::DEBUG::2014-01-24 19:44:53,685::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1115::INFO::2014-01-24 19:44:53,685::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1115::INFO::2014-01-24 19:44:53,686::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:44:53,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:54,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244062 s, 42.0 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:44:54,662::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:44:54,668::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000390191 s, 876 kB/s\n'; <rc> = 0 >Thread-1116::INFO::2014-01-24 19:44:54,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1116::INFO::2014-01-24 19:44:54,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594908', 'lastCheck': '2.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000390191', 'lastCheck': '0.3', 'valid': True}} >Thread-12::DEBUG::2014-01-24 19:44:55,269::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:55,274::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:56,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:56,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275645 s, 37.1 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:57,277::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:57,282::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:44:58,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:44:58,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274322 s, 37.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:44:59,285::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:44:59,290::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:45:00,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:00,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025045 s, 40.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:01,293::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:01,298::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:45:02,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:02,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262581 s, 39.0 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:45:02,748::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:45:02,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064699 s, 6.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:03,301::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:03,306::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1120::DEBUG::2014-01-24 19:45:03,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1120::INFO::2014-01-24 19:45:03,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1120::INFO::2014-01-24 19:45:03,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1121::DEBUG::2014-01-24 19:45:03,757::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1121::INFO::2014-01-24 19:45:03,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1121::INFO::2014-01-24 19:45:03,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}} >Dummy-233::DEBUG::2014-01-24 19:45:04,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:04,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270008 s, 37.9 MB/s\n'; <rc> = 0 >Thread-363::DEBUG::2014-01-24 19:45:04,676::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-363::DEBUG::2014-01-24 19:45:04,681::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000345228 s, 991 kB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:05,309::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:05,314::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:45:06,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:06,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245832 s, 41.7 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:07,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:07,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:45:08,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:08,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275246 s, 37.2 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:09,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:09,330::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1124::INFO::2014-01-24 19:45:10,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-1124::INFO::2014-01-24 19:45:10,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064699', 'lastCheck': '7.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345228', 'lastCheck': '5.4', 'valid': True}} >Dummy-233::DEBUG::2014-01-24 19:45:10,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:10,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270157 s, 37.9 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:11,333::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:11,338::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Dummy-233::DEBUG::2014-01-24 19:45:12,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-233::DEBUG::2014-01-24 19:45:12,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274463 s, 37.3 MB/s\n'; <rc> = 0 >Thread-120::DEBUG::2014-01-24 19:45:12,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None) >Thread-120::DEBUG::2014-01-24 19:45:12,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646908 s, 6.3 MB/s\n'; <rc> = 0 >Thread-12::DEBUG::2014-01-24 19:45:13,341::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None) >Thread-12::DEBUG::2014-01-24 19:45:13,346::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-1127::DEBUG::2014-01-24 19:45:13,803::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1127::INFO::2014-01-24 19:45:13,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1127::INFO::2014-01-24 19:45:13,803::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-1128::DEBUG::2014-01-24 19:45:13,820::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] >Thread-1128::INFO::2014-01-24 19:45:13,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None) >Thread-1128::INFO::2014-01-24 19:45:13,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1057764
:
855153
| 855154 |
857629
|
857630