Attachment 855154 Details for Bug 1057764 – vdsm log

vdsm log

vdsm.log (text/x-log), 1.35 MB, created by Carlos Mestre González on 2014-01-24 18:48:14 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Carlos Mestre González

Created: 2014-01-24 18:48:14 UTC

Size: 1.35 MB

patch

obsolete

>Thread-491::DEBUG::2014-01-24 19:08:28,324::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:29,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:29,595::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-485::DEBUG::2014-01-24 19:08:31,001::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-485::DEBUG::2014-01-24 19:08:31,002::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1']
>Thread-485::DEBUG::2014-01-24 19:08:31,002::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-491::DEBUG::2014-01-24 19:08:31,079::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-491::DEBUG::2014-01-24 19:08:31,084::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 2a36092f-90ff-444a-b58c-df8cd0759196 changed its status to Valid
>Thread-493::DEBUG::2014-01-24 19:08:31,085::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-493::DEBUG::2014-01-24 19:08:31,085::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-493::DEBUG::2014-01-24 19:08:31,086::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-494::INFO::2014-01-24 19:08:31,090::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-12::DEBUG::2014-01-24 19:08:31,602::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:31,606::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:08:33,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:33,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-496::INFO::2014-01-24 19:08:35,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-496::INFO::2014-01-24 19:08:35,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00052633', 'lastCheck': '4.4', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:08:35,616::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:35,621::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-485::DEBUG::2014-01-24 19:08:37,598::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-485::WARNING::2014-01-24 19:08:37,600::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/images already exists
>Thread-485::WARNING::2014-01-24 19:08:37,601::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/dom_md already exists
>Thread-485::INFO::2014-01-24 19:08:37,601::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196 to /rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/2a36092f-90ff-444a-b58c-df8cd0759196
>Thread-485::INFO::2014-01-24 19:08:37,602::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196 to /rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd
>Thread-485::DEBUG::2014-01-24 19:08:37,603::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None)
>Thread-485::DEBUG::2014-01-24 19:08:37,610::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00248133 s, 1.7 MB/s\n'; <rc> = 0
>Thread-485::INFO::2014-01-24 19:08:37,610::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8']
>Thread-485::DEBUG::2014-01-24 19:08:37,611::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:37,624::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:37,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-485::DEBUG::2014-01-24 19:08:38,616::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00137 s, 4.1 kB/s\n'; <rc> = 0
>Thread-485::DEBUG::2014-01-24 19:08:38,616::storage_mailbox::209::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool c08b415a-44b7-4885-adad-a16c66e15971
>Thread-485::DEBUG::2014-01-24 19:08:38,617::sp::491::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool c08b415a-44b7-4885-adad-a16c66e15971 on master domain 2a36092f-90ff-444a-b58c-df8cd0759196
>Thread-485::INFO::2014-01-24 19:08:38,618::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-505::DEBUG::2014-01-24 19:08:38,756::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-505::INFO::2014-01-24 19:08:38,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', options=None)
>Thread-505::INFO::2014-01-24 19:08:38,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}}
>Thread-506::DEBUG::2014-01-24 19:08:38,809::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-506::INFO::2014-01-24 19:08:38,809::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', prevID=-1, prevLVER='0', maxHostID=250, domVersion='3', options=None)
>Thread-506::INFO::2014-01-24 19:08:38,810::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:38,811::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:39,632::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:39,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-507::DEBUG::2014-01-24 19:08:39,821::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-507::INFO::2014-01-24 19:08:39,822::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-507::INFO::2014-01-24 19:08:39,822::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-508::DEBUG::2014-01-24 19:08:40,828::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-508::INFO::2014-01-24 19:08:40,828::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-508::INFO::2014-01-24 19:08:40,828::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-491::DEBUG::2014-01-24 19:08:41,087::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:41,351::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:41,352::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1']
>Thread-12::DEBUG::2014-01-24 19:08:41,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:41,644::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-510::DEBUG::2014-01-24 19:08:41,834::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-510::INFO::2014-01-24 19:08:41,835::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-510::INFO::2014-01-24 19:08:41,835::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-511::DEBUG::2014-01-24 19:08:42,841::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-511::INFO::2014-01-24 19:08:42,842::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-511::INFO::2014-01-24 19:08:42,842::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-491::DEBUG::2014-01-24 19:08:43,419::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-491::DEBUG::2014-01-24 19:08:43,422::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata bs=4096 count=1' (cwd None)
>Thread-491::DEBUG::2014-01-24 19:08:43,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653204 s, 6.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:08:43,647::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:43,651::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-512::DEBUG::2014-01-24 19:08:43,848::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-512::INFO::2014-01-24 19:08:43,849::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-512::INFO::2014-01-24 19:08:43,849::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-514::DEBUG::2014-01-24 19:08:44,855::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-514::INFO::2014-01-24 19:08:44,855::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-514::INFO::2014-01-24 19:08:44,855::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:45,654::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:45,658::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-515::DEBUG::2014-01-24 19:08:45,863::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-515::INFO::2014-01-24 19:08:45,863::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-515::INFO::2014-01-24 19:08:45,864::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-516::DEBUG::2014-01-24 19:08:46,870::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-516::INFO::2014-01-24 19:08:46,870::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-516::INFO::2014-01-24 19:08:46,870::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:47,661::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:47,665::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-518::DEBUG::2014-01-24 19:08:47,877::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-518::INFO::2014-01-24 19:08:47,877::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-518::INFO::2014-01-24 19:08:47,877::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-519::DEBUG::2014-01-24 19:08:48,892::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-519::INFO::2014-01-24 19:08:48,893::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-519::INFO::2014-01-24 19:08:48,894::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:49,669::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:49,673::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-520::DEBUG::2014-01-24 19:08:49,900::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-520::INFO::2014-01-24 19:08:49,900::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-520::INFO::2014-01-24 19:08:49,900::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-521::INFO::2014-01-24 19:08:50,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-521::INFO::2014-01-24 19:08:50,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00052633', 'lastCheck': '19.7', 'valid': True}}
>Thread-523::DEBUG::2014-01-24 19:08:50,906::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-523::INFO::2014-01-24 19:08:50,906::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-523::INFO::2014-01-24 19:08:50,906::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:51,676::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:51,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-524::DEBUG::2014-01-24 19:08:51,933::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-524::INFO::2014-01-24 19:08:51,934::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-524::INFO::2014-01-24 19:08:51,934::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:08:52,354::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/images already exists
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:08:52,354::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/dom_md already exists
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,355::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,357::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602569 s, 3.4 MB/s\n'; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602569 s, 3.4 MB/s'], size: 2048
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,361::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,362::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:52,362::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-525::DEBUG::2014-01-24 19:08:52,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-525::INFO::2014-01-24 19:08:52,941::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-525::INFO::2014-01-24 19:08:52,941::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:53,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:53,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-527::DEBUG::2014-01-24 19:08:53,982::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-527::INFO::2014-01-24 19:08:53,984::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-527::INFO::2014-01-24 19:08:53,984::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,844::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,845::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,904::sp::298::Storage.StoragePool::(startSpm) spm lock acquired successfully
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:54,905::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-528::DEBUG::2014-01-24 19:08:54,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-528::INFO::2014-01-24 19:08:54,991::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-528::INFO::2014-01-24 19:08:54,991::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:08:55,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:55,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-529::DEBUG::2014-01-24 19:08:55,997::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-529::INFO::2014-01-24 19:08:55,998::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-529::INFO::2014-01-24 19:08:55,998::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-531::DEBUG::2014-01-24 19:08:57,003::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-531::INFO::2014-01-24 19:08:57,004::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-531::INFO::2014-01-24 19:08:57,004::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,427::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', '_SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af', 'POOL_SPM_ID=-1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,428::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:57,429::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:57,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:57,701::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-532::DEBUG::2014-01-24 19:08:58,010::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-532::INFO::2014-01-24 19:08:58,010::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-532::INFO::2014-01-24 19:08:58,010::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-533::DEBUG::2014-01-24 19:08:59,017::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-533::INFO::2014-01-24 19:08:59,018::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-533::INFO::2014-01-24 19:08:59,019::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,682::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,683::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT__SHA_CKSUM=3900d7fefb8f62220885329ad7a03e134b56d9af --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=0 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3 --addtag MDT_POOL_SPM_LVER=1 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:59,704::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:08:59,710::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,847::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,847::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:08:59,848::sp::462::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `2a36092f-90ff-444a-b58c-df8cd0759196`
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:08:59,849::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-535::DEBUG::2014-01-24 19:09:00,027::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-535::INFO::2014-01-24 19:09:00,028::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-535::INFO::2014-01-24 19:09:00,028::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-536::DEBUG::2014-01-24 19:09:01,044::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-536::INFO::2014-01-24 19:09:01,044::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-536::INFO::2014-01-24 19:09:01,044::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:09:01,715::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:01,719::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-537::DEBUG::2014-01-24 19:09:02,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-537::INFO::2014-01-24 19:09:02,051::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-537::INFO::2014-01-24 19:09:02,051::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,060::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,061::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,062::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000531815 s, 3.9 MB/s\n'; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000531815 s, 3.9 MB/s'], size: 2048
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,067::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,068::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:02,068::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-539::DEBUG::2014-01-24 19:09:03,057::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-539::INFO::2014-01-24 19:09:03,057::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-539::INFO::2014-01-24 19:09:03,058::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:09:03,722::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:03,726::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-540::DEBUG::2014-01-24 19:09:04,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-540::INFO::2014-01-24 19:09:04,064::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-540::INFO::2014-01-24 19:09:04,064::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,271::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,272::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_imageNS already registered
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_volumeNS already registered
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::INFO::2014-01-24 19:09:04,272::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_lvmActivationNS already registered
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,274::sp::467::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
>Thread-491::DEBUG::2014-01-24 19:09:04,275::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:04,281::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-491::DEBUG::2014-01-24 19:09:04,369::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-491::DEBUG::2014-01-24 19:09:04,371::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata bs=4096 count=1' (cwd None)
>Thread-491::DEBUG::2014-01-24 19:09:04,376::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000602092 s, 6.8 MB/s\n'; <rc> = 0
>Thread-491::DEBUG::2014-01-24 19:09:04,377::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-541::DEBUG::2014-01-24 19:09:05,070::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-541::INFO::2014-01-24 19:09:05,071::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-541::INFO::2014-01-24 19:09:05,071::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:09:05,729::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:05,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-542::INFO::2014-01-24 19:09:05,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-542::INFO::2014-01-24 19:09:05,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'2a36092f-90ff-444a-b58c-df8cd0759196': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653204', 'lastCheck': '13.5', 'valid': True}}
>Thread-544::DEBUG::2014-01-24 19:09:06,077::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-544::INFO::2014-01-24 19:09:06,077::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-544::INFO::2014-01-24 19:09:06,078::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,548::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::sp::474::Storage.StoragePool::(_upgradePool) Registering with state change event
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,549::sp::477::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::WARNING::2014-01-24 19:09:06,550::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master already exists
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,550::blockSD::1137::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,590::blockSD::1137::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,590::blockSD::1162::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,599::blockSD::1162::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,600::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/2a36092f-90ff-444a-b58c-df8cd0759196/master /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,621::blockSD::1174::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,635::blockSD::1174::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,635::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master/vms
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,636::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master/tasks
>Thread-491::DEBUG::2014-01-24 19:09:06,640::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:06,642::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-545::DEBUG::2014-01-24 19:09:07,085::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-545::INFO::2014-01-24 19:09:07,089::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-545::INFO::2014-01-24 19:09:07,089::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-12::DEBUG::2014-01-24 19:09:07,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:07,741::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-546::DEBUG::2014-01-24 19:09:08,096::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-546::INFO::2014-01-24 19:09:08,096::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-546::INFO::2014-01-24 19:09:08,096::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,940::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,941::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3', 'POOL_SPM_LVER=1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,949::storage_mailbox::576::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1']
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,951::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,993::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360325 s, 28.4 MB/s\n'; <rc> = 0
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,993::storage_mailbox::584::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool c08b415a-44b7-4885-adad-a16c66e15971
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,994::sp::349::Storage.StoragePool::(startSpm) SPM mailbox ready for pool c08b415a-44b7-4885-adad-a16c66e15971 on master domain 2a36092f-90ff-444a-b58c-df8cd0759196
>Dummy-552::DEBUG::2014-01-24 19:09:08,994::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>03525778-e2ca-4a94-bcb5-34b424d1b6d2::DEBUG::2014-01-24 19:09:08,995::sp::357::Storage.StoragePool::(startSpm) ended.
>Dummy-552::DEBUG::2014-01-24 19:09:09,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276255 s, 37.1 MB/s\n'; <rc> = 0
>Thread-554::DEBUG::2014-01-24 19:09:09,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-554::INFO::2014-01-24 19:09:09,133::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-554::INFO::2014-01-24 19:09:09,133::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '03525778-e2ca-4a94-bcb5-34b424d1b6d2'}}
>Thread-555::DEBUG::2014-01-24 19:09:09,200::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-555::INFO::2014-01-24 19:09:09,200::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', options=None)
>Thread-555::INFO::2014-01-24 19:09:09,201::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}}
>Thread-556::DEBUG::2014-01-24 19:09:09,242::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-556::INFO::2014-01-24 19:09:09,243::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='03525778-e2ca-4a94-bcb5-34b424d1b6d2', spUUID=None, options=None)
>Thread-556::INFO::2014-01-24 19:09:09,243::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-557::DEBUG::2014-01-24 19:09:09,322::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-557::INFO::2014-01-24 19:09:09,322::logUtils::44::dispatcher::(wrapper) Run and protect: destroyStoragePool(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', hostID=1, options=None)
>Thread-557::INFO::2014-01-24 19:09:09,322::hsm::1122::Storage.HSM::(destroyStoragePool) spUUID=c08b415a-44b7-4885-adad-a16c66e15971
>Thread-557::WARNING::2014-01-24 19:09:09,323::sp::972::Storage.StoragePool::(forcedDetachSD) Force detaching domain `2a36092f-90ff-444a-b58c-df8cd0759196`
>Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-557::DEBUG::2014-01-24 19:09:09,324::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f']
>Thread-557::DEBUG::2014-01-24 19:09:09,325::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:09,744::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:09,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-552::DEBUG::2014-01-24 19:09:11,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-552::DEBUG::2014-01-24 19:09:11,109::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269429 s, 38.0 MB/s\n'; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:11,560::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:11,561::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT__SHA_CKSUM=1755c59a25e2e898e71a4290f4977544c4138fb3 --deltag MDT_POOL_DOMAINS=2a36092f-90ff-444a-b58c-df8cd0759196:Active --addtag MDT_POOL_DOMAINS= --addtag MDT__SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-557::DEBUG::2014-01-24 19:09:11,741::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:11,741::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-557::DEBUG::2014-01-24 19:09:11,742::sp::367::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process
>Thread-557::DEBUG::2014-01-24 19:09:11,745::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping
>Thread-557::DEBUG::2014-01-24 19:09:11,747::sp::405::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master
>Thread-12::DEBUG::2014-01-24 19:09:11,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:11,766::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:12,118::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>Thread-557::DEBUG::2014-01-24 19:09:12,215::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping
>Thread-557::DEBUG::2014-01-24 19:09:12,216::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping
>Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-557::DEBUG::2014-01-24 19:09:12,217::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7']
>Thread-557::DEBUG::2014-01-24 19:09:12,218::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:13,784::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:13,789::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-552::INFO::2014-01-24 19:09:14,950::storage_mailbox::796::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped
>Thread-557::DEBUG::2014-01-24 19:09:15,501::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:15,502::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=84bc94cdf187b1ebe56a27392c1f9bcb97d7372f --addtag MDT__SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7 --addtag MDT_POOL_SPM_ID=-1 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-557::DEBUG::2014-01-24 19:09:15,675::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:15,675::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-557::DEBUG::2014-01-24 19:09:15,725::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:15,792::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:15,797::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:17,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:17,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:17,949::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:17,950::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7', 'POOL_SPM_ID=-1']
>Thread-557::INFO::2014-01-24 19:09:17,951::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 2a36092f-90ff-444a-b58c-df8cd0759196
>Thread-491::DEBUG::2014-01-24 19:09:17,951::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 2a36092f-90ff-444a-b58c-df8cd0759196
>Thread-12::DEBUG::2014-01-24 19:09:19,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:19,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:19,952::sp::1495::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `c08b415a-44b7-4885-adad-a16c66e15971` stopped monitoring domain `2a36092f-90ff-444a-b58c-df8cd0759196`
>Thread-557::DEBUG::2014-01-24 19:09:19,952::sp::989::Storage.StoragePool::(forcedDetachSD) Force detach for domain `2a36092f-90ff-444a-b58c-df8cd0759196` is done
>Thread-557::DEBUG::2014-01-24 19:09:19,953::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-561::INFO::2014-01-24 19:09:21,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-561::INFO::2014-01-24 19:09:21,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:09:21,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:21,821::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:23,824::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:23,828::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:24,287::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:24,288::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['ROLE=Master', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', '_SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7', 'POOL_SPM_ID=-1']
>Thread-557::DEBUG::2014-01-24 19:09:24,288::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-557::DEBUG::2014-01-24 19:09:24,289::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=1', 'POOL_UUID=', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314']
>Thread-557::DEBUG::2014-01-24 19:09:24,290::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:25,831::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:25,836::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:26,530::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:26,532::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT_ROLE=Master --deltag MDT__SHA_CKSUM=93ff3a53da373ab9add54350b044c43af318e2c7 --deltag MDT_POOL_UUID=c08b415a-44b7-4885-adad-a16c66e15971 --addtag MDT__SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314 --addtag MDT_ROLE=Regular --addtag MDT_POOL_UUID= 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-557::DEBUG::2014-01-24 19:09:26,693::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:26,693::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-557::INFO::2014-01-24 19:09:26,694::sp::698::Storage.StoragePool::(disconnect) Disconnect from the storage pool c08b415a-44b7-4885-adad-a16c66e15971
>Thread-12::DEBUG::2014-01-24 19:09:27,839::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:27,843::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:28,608::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-503::INFO::2014-01-24 19:09:28,622::storage_mailbox::511::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail
>Thread-503::INFO::2014-01-24 19:09:28,622::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8']
>Thread-503::DEBUG::2014-01-24 19:09:28,622::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/c08b415a-44b7-4885-adad-a16c66e15971/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:29,846::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:29,851::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:31,129::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-557::DEBUG::2014-01-24 19:09:31,131::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID=']
>Thread-557::INFO::2014-01-24 19:09:31,132::logUtils::47::dispatcher::(wrapper) Run and protect: destroyStoragePool, Return response: True
>Thread-566::DEBUG::2014-01-24 19:09:31,181::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-566::INFO::2014-01-24 19:09:31,182::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='c08b415a-44b7-4885-adad-a16c66e15971', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None)
>Thread-566::DEBUG::2014-01-24 19:09:31,189::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 6 -u' (cwd None)
>Thread-566::DEBUG::2014-01-24 19:09:31,764::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-566::DEBUG::2014-01-24 19:09:31,764::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-566::DEBUG::2014-01-24 19:09:31,765::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:31,854::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:31,859::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:33,861::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:33,866::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:35,869::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:35,873::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-566::DEBUG::2014-01-24 19:09:36,022::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-568::INFO::2014-01-24 19:09:36,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-568::INFO::2014-01-24 19:09:36,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:09:37,876::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:37,880::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-566::DEBUG::2014-01-24 19:09:39,409::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-566::INFO::2014-01-24 19:09:39,410::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]}
>Thread-571::DEBUG::2014-01-24 19:09:39,421::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1817e9f9]
>Thread-571::INFO::2014-01-24 19:09:39,422::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='c08b415a-44b7-4885-adad-a16c66e15971', hostID=1, remove=False, options=None)
>Thread-571::WARNING::2014-01-24 19:09:39,422::hsm::1088::Storage.HSM::(disconnectStoragePool) disconnect sp: c08b415a-44b7-4885-adad-a16c66e15971 failed. Known pools {}
>Thread-571::INFO::2014-01-24 19:09:39,422::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: None
>Thread-12::DEBUG::2014-01-24 19:09:39,883::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:39,888::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:41,529::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [392b1956]
>Thread-572::INFO::2014-01-24 19:09:41,529::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None)
>Thread-572::DEBUG::2014-01-24 19:09:41,529::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-572::DEBUG::2014-01-24 19:09:41,540::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:41,541::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:41,891::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:41,895::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:42,109::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:42,110::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None)
>Thread-572::DEBUG::2014-01-24 19:09:42,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:42,125::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:43,898::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:43,903::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:45,908::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:45,912::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:47,915::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:47,919::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:48,564::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-572::DEBUG::2014-01-24 19:09:48,566::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '2a36092f-90ff-444a-b58c-df8cd0759196')
>Thread-572::DEBUG::2014-01-24 19:09:48,566::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 2a36092f-90ff-444a-b58c-df8cd0759196: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-572::INFO::2014-01-24 19:09:48,566::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]}
>Thread-576::DEBUG::2014-01-24 19:09:48,578::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c]
>Thread-576::INFO::2014-01-24 19:09:48,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', options=None)
>Thread-576::DEBUG::2014-01-24 19:09:48,609::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:49,922::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:49,927::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-576::DEBUG::2014-01-24 19:09:50,922::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-576::INFO::2014-01-24 19:09:50,923::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': '2a36092f-90ff-444a-b58c-df8cd0759196', 'vgfree': '86704652288', 'vgUUID': 'BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': 'BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}}
>Thread-577::DEBUG::2014-01-24 19:09:50,976::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c]
>Thread-577::INFO::2014-01-24 19:09:50,976::logUtils::44::dispatcher::(wrapper) Run and protect: formatStorageDomain(sdUUID='2a36092f-90ff-444a-b58c-df8cd0759196', autoDetach=False, options=None)
>Thread-577::DEBUG::2014-01-24 19:09:50,976::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-577::DEBUG::2014-01-24 19:09:50,977::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-578::INFO::2014-01-24 19:09:51,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-578::INFO::2014-01-24 19:09:51,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:09:51,931::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:51,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:09:53,299::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:53,938::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:53,943::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:09:55,862::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:09:55,863::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-577::DEBUG::2014-01-24 19:09:55,863::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:55,946::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:55,951::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:09:57,957::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:57,961::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:09:58,355::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:59,964::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:09:59,970::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:01,050::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:01,053::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:01,975::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:01,986::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:03,313::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:03,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-577::DEBUG::2014-01-24 19:10:03,317::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/2a36092f-90ff-444a-b58c-df8cd0759196/metadata count=1' (cwd None)
>Thread-577::DEBUG::2014-01-24 19:10:03,322::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000616359 s, 3.3 MB/s\n'; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:03,322::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000616359 s, 3.3 MB/s'], size: 2048
>Thread-577::DEBUG::2014-01-24 19:10:03,322::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-577::DEBUG::2014-01-24 19:10:03,322::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-577::DEBUG::2014-01-24 19:10:03,323::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:03,992::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:03,996::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:05,605::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:05,606::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID=']
>Thread-577::INFO::2014-01-24 19:10:05,606::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_imageNS already registered
>Thread-577::INFO::2014-01-24 19:10:05,606::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_volumeNS already registered
>Thread-577::INFO::2014-01-24 19:10:05,606::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 2a36092f-90ff-444a-b58c-df8cd0759196_lvmActivationNS already registered
>Thread-577::DEBUG::2014-01-24 19:10:05,607::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:05,999::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:06,004::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-584::INFO::2014-01-24 19:10:06,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-584::INFO::2014-01-24 19:10:06,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-577::DEBUG::2014-01-24 19:10:07,807::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:07,808::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=BLT4wx-ZgEd-Fj1P-RYH5-B7aD-YqcZ-Dr2aXx', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'SDUUID=2a36092f-90ff-444a-b58c-df8cd0759196', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', u'PV0=pv:1cmg01,uuid:bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui,pestart:0,pecount:677,mapoffset:0', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'VERSION=3', 'POOL_SPM_LVER=1', 'POOL_DOMAINS=', 'POOL_SPM_ID=-1', '_SHA_CKSUM=59836211cda7718f65a0b6d7a3e8bb0ba3984314', 'ROLE=Regular', 'POOL_UUID=']
>Thread-577::DEBUG::2014-01-24 19:10:07,808::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-577::DEBUG::2014-01-24 19:10:07,902::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:07,905::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-577::WARNING::2014-01-24 19:10:07,905::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/master
>Thread-577::DEBUG::2014-01-24 19:10:07,906::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/master' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:08,007::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:08,014::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:08,023::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::WARNING::2014-01-24 19:10:08,023::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/leases
>Thread-577::DEBUG::2014-01-24 19:10:08,024::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/leases' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:10,018::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:10,026::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:10,379::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::WARNING::2014-01-24 19:10:10,380::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/inbox
>Thread-577::DEBUG::2014-01-24 19:10:10,380::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/inbox' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:12,033::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:12,037::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:12,590::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::WARNING::2014-01-24 19:10:12,590::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/outbox
>Thread-577::DEBUG::2014-01-24 19:10:12,590::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/outbox' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:14,040::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:14,045::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:15,074::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::WARNING::2014-01-24 19:10:15,074::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/ids
>Thread-577::DEBUG::2014-01-24 19:10:15,074::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/ids' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:16,051::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:16,055::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:17,340::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::WARNING::2014-01-24 19:10:17,340::lvm::1094::Storage.LVM::(removeLVs) Removing active volume 2a36092f-90ff-444a-b58c-df8cd0759196/metadata
>Thread-577::DEBUG::2014-01-24 19:10:17,341::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f --autobackup n 2a36092f-90ff-444a-b58c-df8cd0759196/metadata' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:18,058::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:18,062::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:20,065::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:20,070::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:20,445::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:20,446::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgremove --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " -f 2a36092f-90ff-444a-b58c-df8cd0759196' (cwd None)
>Thread-590::INFO::2014-01-24 19:10:21,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-590::INFO::2014-01-24 19:10:21,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:10:22,072::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:22,077::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::DEBUG::2014-01-24 19:10:22,752::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-577::INFO::2014-01-24 19:10:22,753::logUtils::47::dispatcher::(wrapper) Run and protect: formatStorageDomain, Return response: None
>Thread-592::DEBUG::2014-01-24 19:10:22,768::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [5754475c]
>Thread-592::INFO::2014-01-24 19:10:22,768::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219', 'port': '3260'}], options=None)
>Thread-592::DEBUG::2014-01-24 19:10:22,775::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -r 7 -u' (cwd None)
>Thread-592::DEBUG::2014-01-24 19:10:23,345::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-592::DEBUG::2014-01-24 19:10:23,345::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-592::DEBUG::2014-01-24 19:10:23,346::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:24,080::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:24,085::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:26,089::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:26,094::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-592::DEBUG::2014-01-24 19:10:27,580::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:28,097::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:28,101::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:30,104::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:30,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-592::DEBUG::2014-01-24 19:10:30,784::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-592::INFO::2014-01-24 19:10:30,785::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'daf41d0d-366a-4d35-b9f3-b69ed9031219'}]}
>Thread-12::DEBUG::2014-01-24 19:10:32,117::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:32,122::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-596::INFO::2014-01-24 19:10:33,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-596::INFO::2014-01-24 19:10:33,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:10:34,125::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:34,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:36,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:36,136::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:38,139::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:38,143::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:40,146::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:40,151::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:42,154::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:42,158::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:44,161::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:44,166::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:46,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:46,173::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:48,176::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:48,180::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:50,183::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:50,187::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:52,190::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:52,194::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:54,197::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:54,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:56,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:56,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:10:58,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:10:58,215::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:00,218::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:00,222::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:02,225::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:02,229::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:04,232::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:04,237::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:06,240::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:06,244::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:08,247::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:08,251::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:10,254::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:10,258::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:12,261::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:12,265::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:14,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:14,272::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:16,275::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:16,279::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:18,282::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:18,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:20,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:20,293::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:22,296::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:22,300::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:24,303::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:24,307::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:26,310::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:26,314::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:28,317::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:28,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:30,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:30,328::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:32,331::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:32,335::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:34,338::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:34,342::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:36,345::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:36,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:38,352::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:38,356::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:40,359::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:40,363::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:42,366::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:42,370::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:44,373::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:44,377::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:46,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:46,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:48,386::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:48,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:50,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:50,398::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:52,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:52,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:54,407::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:54,412::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:56,414::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:56,419::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:11:58,421::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:11:58,426::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:00,428::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:00,433::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:02,435::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:02,440::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:04,442::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:04,447::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:06,450::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:06,454::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:08,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:08,461::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:10,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:10,468::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:12,470::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:12,474::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:14,477::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:14,481::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:16,484::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:16,488::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:18,491::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:18,495::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:20,498::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:20,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:22,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:22,509::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:24,512::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:24,516::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:26,519::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:26,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:28,526::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:28,530::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:30,533::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:30,537::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:32,540::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:32,544::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:34,547::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:34,551::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:36,554::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:36,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:38,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:38,565::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:40,568::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:40,572::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:42,575::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:42,579::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:44,582::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:44,586::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:46,589::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:46,595::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:48,598::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:48,602::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:50,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:50,609::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:52,612::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:52,616::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:54,619::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:54,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:56,626::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:56,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:12:58,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:12:58,638::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:00,641::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:00,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:02,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:02,652::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:04,655::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:04,659::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:06,662::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:06,666::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:08,669::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:08,673::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:10,676::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:10,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:12,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:12,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:14,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:14,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:16,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:16,701::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:18,704::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:18,708::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:20,711::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:20,715::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:22,718::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:22,722::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:24,725::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:24,729::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:26,732::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:26,736::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:28,739::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:28,743::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:30,746::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:30,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:32,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:32,757::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:34,760::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:34,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:36,767::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:36,771::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:38,774::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:38,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:40,781::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:40,785::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:42,788::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:42,792::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:44,795::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:44,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:46,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:46,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:48,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:48,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:50,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:50,821::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:52,823::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:52,828::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:54,830::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:54,835::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:56,838::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:56,842::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:13:58,844::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:13:58,849::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:00,852::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:00,856::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:02,858::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:02,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:04,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:04,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:06,872::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:06,876::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:08,879::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:08,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:10,886::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:10,890::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:12,893::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:12,897::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:14,900::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:14,904::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:16,907::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:16,911::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:18,914::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:18,918::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:20,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:20,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:22,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:22,932::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:24,935::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:24,939::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:26,942::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:26,946::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:28,949::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:28,953::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:30,956::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:30,960::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:32,963::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:32,967::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:34,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:34,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:36,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:36,981::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:38,984::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:38,988::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:40,991::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:40,995::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:42,998::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:43,002::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:45,005::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:45,009::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:47,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:47,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:49,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:49,023::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:51,026::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:51,030::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:53,033::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:53,037::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:55,040::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:55,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:57,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:57,051::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:14:59,054::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:14:59,058::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:01,061::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:01,065::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:03,068::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:03,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:05,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:05,079::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:07,082::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:07,086::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:09,089::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:09,093::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:11,096::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:11,100::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:13,103::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:13,107::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:15,110::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:15,114::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:17,117::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:17,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:19,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:19,128::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:21,131::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:21,135::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:23,138::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:23,142::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:25,145::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:25,149::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:27,152::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:27,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:29,159::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:29,164::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:31,166::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:31,170::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:33,173::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:33,177::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:35,180::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:35,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:37,187::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:37,191::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:39,194::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:39,198::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:41,201::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:41,205::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:43,208::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:43,212::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:45,215::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:45,219::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:47,222::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:47,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:49,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:49,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:51,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:51,240::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:53,243::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:53,247::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:55,250::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:55,254::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:57,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:57,261::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:15:59,264::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:15:59,268::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:01,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:01,275::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:03,278::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:03,282::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:05,285::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:05,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:07,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:07,296::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:09,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:09,303::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:11,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:11,310::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:13,313::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:13,317::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:15,320::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:15,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:17,327::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:17,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:19,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:19,339::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:21,342::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:21,346::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:23,349::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:23,353::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:25,356::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:25,360::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:27,363::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:27,367::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:29,370::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:29,374::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:31,377::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:31,381::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:33,384::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:33,388::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:35,391::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:35,395::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:37,398::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:37,402::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:39,405::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:39,409::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:41,412::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:41,416::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:43,418::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:43,422::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:45,425::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:45,430::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:47,432::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:47,437::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:49,439::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:49,444::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:51,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:51,450::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:53,453::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:53,457::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:55,460::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:55,464::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:57,467::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:57,471::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:16:59,474::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:16:59,478::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:01,481::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:01,485::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:03,488::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:03,492::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:05,495::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:05,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:07,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:07,506::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:09,509::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:09,514::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:11,516::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:11,520::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:13,523::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:13,527::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:15,530::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:15,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:17,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:17,541::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:19,544::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:19,548::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:21,551::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:21,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:23,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:23,562::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:25,565::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:25,569::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:27,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:27,576::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:29,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:29,583::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:31,586::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:31,590::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:33,593::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:33,597::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:35,600::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:35,604::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:37,607::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:37,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:39,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:39,618::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:41,621::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:41,625::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:43,628::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:43,632::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:45,635::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:45,639::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:47,642::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:47,646::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:49,649::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:49,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:51,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:51,660::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:53,663::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:53,667::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:55,670::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:55,674::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:57,677::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:57,681::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:17:59,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:17:59,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:01,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:01,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:03,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:03,702::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:05,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:05,709::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:07,712::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:07,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:09,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:09,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:11,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:11,730::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:13,733::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:13,749::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:15,758::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:15,763::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:17,769::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:17,773::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:19,776::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:19,780::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:21,783::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:21,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:23,790::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:23,794::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:25,797::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:25,812::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:27,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:27,837::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:29,846::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:29,858::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:31,867::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:31,875::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:33,878::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:33,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:18:35,887::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:35,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-01-24 19:18:36,590::vdsm::55::vds::(sigtermHandler) Received signal 15
>MainThread::INFO::2014-01-24 19:18:37,453::vmChannels::183::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-01-24 19:18:37,453::momIF::84::MOM::(stop) Shutting down MOM
>MainThread::INFO::2014-01-24 19:18:37,454::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>MainThread::DEBUG::2014-01-24 19:18:37,457::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:37,458::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:37,459::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:37,460::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping
>VM Channels Listener::INFO::2014-01-24 19:18:37,492::vmChannels::178::vds::(run) VM channels listener thread has ended.
>MainThread::INFO::2014-01-24 19:18:37,803::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::INFO::2014-01-24 19:18:37,803::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
>MainThread::INFO::2014-01-24 19:18:37,803::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 15 other threads...
>MainThread::INFO::2014-01-24 19:18:37,803::vdsm::129::vds::(run) <_MainThread(MainThread, started 139732044535552)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 139731910616832)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 139731879147264)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 139731900126976)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 139731660699392)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 139731608250112)>
>MainThread::INFO::2014-01-24 19:18:37,804::momIF::84::MOM::(stop) Shutting down MOM
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <MomThread(MOM, started 139731148977920)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 139731629229824)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 139731639719680)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 139731190937344)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 139731618739968)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <HostMonitor(HostMonitor, started daemon 139731138488064)>
>MainThread::INFO::2014-01-24 19:18:37,804::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 139730679080704)>
>MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <WorkerThread(612b8a1c-fc4a-4b9e-9528-f079dab1b54f, started daemon 139731650209536)>
>MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 139730689570560)>
>MainThread::INFO::2014-01-24 19:18:37,805::vdsm::129::vds::(run) <WorkerThread(03525778-e2ca-4a94-bcb5-34b424d1b6d2, started daemon 139731889637120)>
>MainThread::INFO::2014-01-24 19:18:45,677::vdsm::119::vds::(run) (PID: 14246) I am the actual vdsm 4.14.0-21.git54cc674.el6 dell-r210ii-14.rhev.lab.eng.brq.redhat.com (2.6.32-431.el6.x86_64)
>MainThread::WARNING::2014-01-24 19:18:45,680::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-01-24 19:18:45,683::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c166f2fa-07fb-43e5-8e54-8fe9c3fa24ed/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:45,685::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/2a36092f-90ff-444a-b58c-df8cd0759196/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:45,686::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ecae8567-4ea9-4dca-ac08-4e77d58f6c3d/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:45,688::sp::411::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/91fb188b-840a-4af2-85b2-fcde260f3902/master` is not mounted, skipping
>MainThread::DEBUG::2014-01-24 19:18:46,119::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-01-24 19:18:46,119::hsm::420::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None)
>MainThread::DEBUG::2014-01-24 19:18:46,220::hsm::420::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-01-24 19:18:46,220::hsm::444::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::476::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::477::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-01-24 19:18:46,222::hsm::479::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-01-24 19:18:46,223::hsm::522::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>MainThread::INFO::2014-01-24 19:18:46,224::dispatcher::99::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-01-24 19:18:46,224::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-01-24 19:18:46,241::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>MainThread::INFO::2014-01-24 19:18:46,257::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1992290>>)
>MainThread::INFO::2014-01-24 19:18:46,257::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-01-24 19:18:46,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>MainThread::DEBUG::2014-01-24 19:18:46,262::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>MainThread::INFO::2014-01-24 19:18:46,266::momIF::47::MOM::(__init__) Starting up MOM
>MainThread::INFO::2014-01-24 19:18:46,268::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds.
>VM Channels Listener::INFO::2014-01-24 19:18:46,270::vmChannels::170::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-01-24 19:18:46,277::libvirtconnection::145::root::(get) trying to connect libvirt
>MainThread::WARNING::2014-01-24 19:18:46,283::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed.
>Thread-13::DEBUG::2014-01-24 19:18:46,612::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-13::DEBUG::2014-01-24 19:18:46,612::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-14::DEBUG::2014-01-24 19:18:47,249::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-14::DEBUG::2014-01-24 19:18:47,249::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-15::DEBUG::2014-01-24 19:18:47,808::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-15::DEBUG::2014-01-24 19:18:47,808::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:48,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:48,273::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-01-24 19:18:48,318::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-16::DEBUG::2014-01-24 19:18:48,330::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-16::DEBUG::2014-01-24 19:18:48,330::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-17::DEBUG::2014-01-24 19:18:48,877::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-17::DEBUG::2014-01-24 19:18:48,877::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-18::DEBUG::2014-01-24 19:18:49,421::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-18::DEBUG::2014-01-24 19:18:49,421::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-19::DEBUG::2014-01-24 19:18:49,942::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-19::DEBUG::2014-01-24 19:18:49,945::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:50,276::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:50,281::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-20::DEBUG::2014-01-24 19:18:50,464::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-20::DEBUG::2014-01-24 19:18:50,464::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-21::DEBUG::2014-01-24 19:18:50,996::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-21::DEBUG::2014-01-24 19:18:50,996::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-22::DEBUG::2014-01-24 19:18:51,531::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-22::DEBUG::2014-01-24 19:18:51,533::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>storageRefresh::DEBUG::2014-01-24 19:18:51,788::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-01-24 19:18:51,791::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>Thread-23::DEBUG::2014-01-24 19:18:52,070::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-23::DEBUG::2014-01-24 19:18:52,070::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:52,284::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:52,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-24::DEBUG::2014-01-24 19:18:52,593::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-24::DEBUG::2014-01-24 19:18:52,593::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-25::DEBUG::2014-01-24 19:18:53,108::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-25::DEBUG::2014-01-24 19:18:53,108::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-26::DEBUG::2014-01-24 19:18:53,623::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-26::DEBUG::2014-01-24 19:18:53,623::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-27::DEBUG::2014-01-24 19:18:54,148::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-27::DEBUG::2014-01-24 19:18:54,148::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:54,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:54,296::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-28::DEBUG::2014-01-24 19:18:54,680::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-28::DEBUG::2014-01-24 19:18:54,680::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-29::DEBUG::2014-01-24 19:18:55,193::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-29::DEBUG::2014-01-24 19:18:55,193::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-30::DEBUG::2014-01-24 19:18:55,712::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-30::DEBUG::2014-01-24 19:18:55,712::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-31::DEBUG::2014-01-24 19:18:56,235::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-31::DEBUG::2014-01-24 19:18:56,235::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:56,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:56,303::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-01-24 19:18:56,576::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-01-24 19:18:56,577::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-32::DEBUG::2014-01-24 19:18:56,758::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-32::DEBUG::2014-01-24 19:18:56,758::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-33::DEBUG::2014-01-24 19:18:57,273::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-33::DEBUG::2014-01-24 19:18:57,273::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-34::DEBUG::2014-01-24 19:18:57,810::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-34::DEBUG::2014-01-24 19:18:57,810::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:18:58,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:18:58,310::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-35::DEBUG::2014-01-24 19:18:58,330::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-35::DEBUG::2014-01-24 19:18:58,330::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-36::DEBUG::2014-01-24 19:18:58,883::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-36::DEBUG::2014-01-24 19:18:58,883::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-37::DEBUG::2014-01-24 19:18:59,437::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-37::DEBUG::2014-01-24 19:18:59,437::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-38::DEBUG::2014-01-24 19:18:59,976::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-38::DEBUG::2014-01-24 19:18:59,976::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:19:00,313::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:00,317::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-39::DEBUG::2014-01-24 19:19:00,493::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-39::DEBUG::2014-01-24 19:19:00,493::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-40::DEBUG::2014-01-24 19:19:01,011::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-40::DEBUG::2014-01-24 19:19:01,011::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-41::DEBUG::2014-01-24 19:19:01,533::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-41::DEBUG::2014-01-24 19:19:01,534::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-42::DEBUG::2014-01-24 19:19:02,050::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-42::DEBUG::2014-01-24 19:19:02,053::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:19:02,320::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:02,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-43::DEBUG::2014-01-24 19:19:02,574::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-43::DEBUG::2014-01-24 19:19:02,574::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-44::DEBUG::2014-01-24 19:19:03,097::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-44::DEBUG::2014-01-24 19:19:03,097::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-45::DEBUG::2014-01-24 19:19:03,617::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-45::DEBUG::2014-01-24 19:19:03,617::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-46::DEBUG::2014-01-24 19:19:04,128::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-46::DEBUG::2014-01-24 19:19:04,129::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:19:04,326::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:04,330::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-47::DEBUG::2014-01-24 19:19:04,642::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-47::DEBUG::2014-01-24 19:19:04,642::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>storageRefresh::DEBUG::2014-01-24 19:19:05,078::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-01-24 19:19:05,079::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None)
>Thread-48::DEBUG::2014-01-24 19:19:05,167::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-48::DEBUG::2014-01-24 19:19:05,167::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-49::DEBUG::2014-01-24 19:19:05,682::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-49::DEBUG::2014-01-24 19:19:05,682::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-50::DEBUG::2014-01-24 19:19:06,200::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-50::DEBUG::2014-01-24 19:19:06,200::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:19:06,333::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:06,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-51::DEBUG::2014-01-24 19:19:06,715::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-51::DEBUG::2014-01-24 19:19:06,715::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-52::DEBUG::2014-01-24 19:19:07,236::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call ping with () {} flowID [4ba6f999]
>Thread-52::DEBUG::2014-01-24 19:19:07,236::BindingXMLRPC::976::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>Thread-12::DEBUG::2014-01-24 19:19:08,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:08,344::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:10,347::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:10,351::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-53::DEBUG::2014-01-24 19:19:10,402::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {}
>Thread-53::DEBUG::2014-01-24 19:19:10,402::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}}
>storageRefresh::DEBUG::2014-01-24 19:19:10,454::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::WARNING::2014-01-24 19:19:10,460::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists
>storageRefresh::DEBUG::2014-01-24 19:19:10,461::hsm::388::Storage.HSM::(storageRefresh) HSM is ready
>Thread-12::DEBUG::2014-01-24 19:19:12,354::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:12,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-54::DEBUG::2014-01-24 19:19:13,579::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {}
>Thread-54::DEBUG::2014-01-24 19:19:13,619::utils::555::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-54::DEBUG::2014-01-24 19:19:13,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-54::DEBUG::2014-01-24 19:19:13,627::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-54::DEBUG::2014-01-24 19:19:13,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-54::DEBUG::2014-01-24 19:19:13,652::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:647f414138d4'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384118394.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '21.git54cc674.el6', 'buildtime': 1389728033L, 'version': '4.14.0'}, 'qemu-kvm': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.2', 'buildtime': 1386770011L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'mom': {'release': '6.el6', 'buildtime': 1385055971L, 'version': '0.3.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['em1']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3e', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': 'd4:ae:52:c7:1e:3e', 'STP': 'no', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}, 'em2': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3f', 'cfg': {'UUID': 'c71cf0c8-07c4-49f6-aac1-b56edc3d0fe3', 'NM_CONTROLLED': 'yes', 'HWADDR': 'D4:AE:52:C7:1E:3F', 'BOOTPROTO': 'dhcp', 'DEVICE': 'em2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}}, 'software_revision': '21', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:647f414138d4', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7906', 'cpuSpeed': '3301.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.34.63.25'}}
>Thread-55::DEBUG::2014-01-24 19:19:13,748::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getHardwareInfo with () {}
>Thread-55::DEBUG::2014-01-24 19:19:13,771::BindingXMLRPC::976::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'PowerEdge R210 II', 'systemSerialNumber': 'J3SRJ5J', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'systemManufacturer': 'Dell Inc.'}}
>Thread-56::DEBUG::2014-01-24 19:19:14,058::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getCapabilities with () {}
>Thread-56::DEBUG::2014-01-24 19:19:14,059::utils::555::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None)
>Thread-56::DEBUG::2014-01-24 19:19:14,063::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-56::DEBUG::2014-01-24 19:19:14,066::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-56::DEBUG::2014-01-24 19:19:14,070::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-56::DEBUG::2014-01-24 19:19:14,082::BindingXMLRPC::976::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:647f414138d4'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384118394.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '21.git54cc674.el6', 'buildtime': 1389728033L, 'version': '4.14.0'}, 'qemu-kvm': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.2', 'buildtime': 1386770011L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.3', 'buildtime': 1384327329L, 'version': '0.12.1.2'}, 'mom': {'release': '6.el6', 'buildtime': 1385055971L, 'version': '0.3.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['em1']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.62.206', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['em1']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'lastClientIface': 'ovirtmgmt', 'nics': {'em1': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3e', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'HWADDR': 'd4:ae:52:c7:1e:3e', 'STP': 'no', 'DEVICE': 'em1', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}, 'em2': {'netmask': '', 'addr': '', 'hwaddr': 'd4:ae:52:c7:1e:3f', 'cfg': {'UUID': 'c71cf0c8-07c4-49f6-aac1-b56edc3d0fe3', 'NM_CONTROLLED': 'yes', 'HWADDR': 'D4:AE:52:C7:1E:3F', 'BOOTPROTO': 'dhcp', 'DEVICE': 'em2', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}}, 'software_revision': '21', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:647f414138d4', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7906', 'cpuSpeed': '3301.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.34.63.25'}}
>Thread-57::DEBUG::2014-01-24 19:19:14,143::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call getHardwareInfo with () {}
>Thread-57::DEBUG::2014-01-24 19:19:14,144::BindingXMLRPC::976::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'PowerEdge R210 II', 'systemSerialNumber': 'J3SRJ5J', 'systemFamily': 'Not Specified', 'systemVersion': 'Not Specified', 'systemUUID': '4C4C4544-0033-5310-8052-CAC04F4A354A', 'systemManufacturer': 'Dell Inc.'}}
>Thread-59::DEBUG::2014-01-24 19:19:14,344::BindingXMLRPC::969::vds::(wrapper) client [10.34.63.25]::call setMOMPolicyParameters with ({'balloonEnabled': False},) {} flowID [672728df]
>Thread-12::DEBUG::2014-01-24 19:19:14,360::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:14,368::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-59::DEBUG::2014-01-24 19:19:14,408::BindingXMLRPC::976::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-12::DEBUG::2014-01-24 19:19:16,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:16,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-60::INFO::2014-01-24 19:19:17,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-60::INFO::2014-01-24 19:19:17,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:19:18,387::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:18,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:20,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:20,398::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-63::DEBUG::2014-01-24 19:19:20,928::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-63::INFO::2014-01-24 19:19:20,928::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.34.63.202', 'password': '******', 'port': '3260', 'user': ''}, options=None)
>Thread-63::DEBUG::2014-01-24 19:19:20,929::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-63::DEBUG::2014-01-24 19:19:20,939::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-63::DEBUG::2014-01-24 19:19:20,939::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --discover' (cwd None)
>Thread-63::DEBUG::2014-01-24 19:19:20,954::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-63::DEBUG::2014-01-24 19:19:20,955::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.63.202:3260 --op=delete' (cwd None)
>Thread-63::DEBUG::2014-01-24 19:19:20,964::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-63::INFO::2014-01-24 19:19:20,964::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.34.63.202:3260,1 iqn.2011-01.brq.str-01:pstehlik', '10.34.63.202:3260,1 iqn.2012-06.brq.str-01:brq-setup', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:cmestreg', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:kjachim', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:lbednar', '10.34.63.202:3260,1 iqn.2012-10.brq.str-01:mbetak', '10.34.63.202:3260,1 iqn.2013-12.brq.str-01:jbelka', '10.34.63.202:3260,1 iqn.2013-12.brq.str-01:mpavlik'], 'targets': ['iqn.2011-01.brq.str-01:pstehlik', 'iqn.2012-06.brq.str-01:brq-setup', 'iqn.2012-10.brq.str-01:cmestreg', 'iqn.2012-10.brq.str-01:kjachim', 'iqn.2012-10.brq.str-01:lbednar', 'iqn.2012-10.brq.str-01:mbetak', 'iqn.2013-12.brq.str-01:jbelka', 'iqn.2013-12.brq.str-01:mpavlik']}
>Thread-64::DEBUG::2014-01-24 19:19:21,411::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4930e73c]
>Thread-64::INFO::2014-01-24 19:19:21,413::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None)
>Thread-64::DEBUG::2014-01-24 19:19:21,413::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-64::DEBUG::2014-01-24 19:19:21,422::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-64::DEBUG::2014-01-24 19:19:21,422::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None)
>Thread-64::DEBUG::2014-01-24 19:19:22,040::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-64::DEBUG::2014-01-24 19:19:22,041::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None)
>Thread-64::DEBUG::2014-01-24 19:19:22,058::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-64::DEBUG::2014-01-24 19:19:22,059::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0',)
>Thread-64::DEBUG::2014-01-24 19:19:22,059::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain}
>Thread-64::INFO::2014-01-24 19:19:22,059::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}
>Thread-12::DEBUG::2014-01-24 19:19:22,401::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:22,411::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:24,417::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:24,421::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-66::DEBUG::2014-01-24 19:19:24,432::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18082755]
>Thread-66::INFO::2014-01-24 19:19:24,432::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '0', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None)
>Thread-66::DEBUG::2014-01-24 19:19:24,433::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-66::DEBUG::2014-01-24 19:19:24,446::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-66::DEBUG::2014-01-24 19:19:24,446::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None)
>Thread-66::DEBUG::2014-01-24 19:19:24,456::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-66::DEBUG::2014-01-24 19:19:24,457::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None)
>Thread-66::DEBUG::2014-01-24 19:19:24,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-66::DEBUG::2014-01-24 19:19:24,465::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c90b62f4-61ad-450d-9ef5-268a6ccb0fc0',)
>Thread-66::DEBUG::2014-01-24 19:19:24,465::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain}
>Thread-66::INFO::2014-01-24 19:19:24,465::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}
>Thread-67::DEBUG::2014-01-24 19:19:24,532::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-67::INFO::2014-01-24 19:19:24,533::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
>Thread-67::DEBUG::2014-01-24 19:19:24,533::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-67::DEBUG::2014-01-24 19:19:24,533::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:26,424::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:26,428::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-01-24 19:19:27,326::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:28,431::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:28,435::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-01-24 19:19:29,814::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-01-24 19:19:29,815::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:30,438::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:30,442::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:32,445::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:32,450::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-70::INFO::2014-01-24 19:19:33,028::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-70::INFO::2014-01-24 19:19:33,028::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-67::DEBUG::2014-01-24 19:19:33,981::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-01-24 19:19:34,398::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c54d5c01d2d /dev/mapper/3514f0c54d5c01d5f /dev/mapper/1cmg02 /dev/mapper/1cmg01' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:34,453::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:34,458::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:36,462::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:36,466::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:38,469::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:38,473::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-67::DEBUG::2014-01-24 19:19:40,387::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff\n  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff\n  Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff\n'; <rc> = 5
>Thread-67::DEBUG::2014-01-24 19:19:40,389::lvm::859::Storage.LVM::(testPVCreate) rc: 5, out: ['  Physical volume "/dev/mapper/1cmg01" successfully created'], err: ['  TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', '  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff', '  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff', '  Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff'], unusedDevs: set(['/dev/mapper/1cmg01']), usedDevs: set(['/dev/mapper/3514f0c54d5c01d5f', '/dev/mapper/3514f0c54d5c01d2d', '/dev/mapper/1cmg02'])
>Thread-67::INFO::2014-01-24 19:19:40,390::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ycYoMs-BCcs-Lkul-v2GF-V6Fy-Mbhr-LPcWAG', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'vEIhYh-t64d-rixc-zdaH-is3J-JAbn-m1ju94', 'serial': 'SXtremIO_XtremApp_92c6101061464169b0001027fc728e1b', 'GUID': '3514f0c54d5c01d2d', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ZO5XUI-KVa3-uvqI-K5ip-7zHm-xI9j-dNhA0P', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'TISsCt-PRFo-aQdO-dyEe-hZG2-M4d7-LOQYJJ', 'serial': 'SXtremIO_XtremApp_91838d02999c45b98b74def227cb4b50', 'GUID': '3514f0c54d5c01d5f', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '102005473280', 'fwrev': '0001', 'vgUUID': '2jFAnJ-0eb2-p5Jy-Qs3w-bOiW-oTPk-4o7Wcu', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'JjZ782-Z9MT-EaGF-ifdA-vAq5-5DBA-XAccgF', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg02', 'productID': 'VIRTUAL-DISK'}, {'status': 'free', 'vendorID': 'RH-str01', 'capacity': '91268055040', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'bOsAet-8gfm-1scu-gq3a-Dbq7-gg9H-bLVIui', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'productID': 'VIRTUAL-DISK'}]}
>Thread-12::DEBUG::2014-01-24 19:19:40,476::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:40,481::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::DEBUG::2014-01-24 19:19:40,714::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec]
>Thread-74::INFO::2014-01-24 19:19:40,715::logUtils::44::dispatcher::(wrapper) Run and protect: createVG(vgname='a250db32-9b39-4533-8bc6-926d4ae17535', devlist=['1cmg01'], force=False, options=None)
>Thread-74::DEBUG::2014-01-24 19:19:40,716::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/1cmg01' (cwd None)
>Thread-74::DEBUG::2014-01-24 19:19:40,826::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::DEBUG::2014-01-24 19:19:40,828::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --metadataignore n /dev/mapper/1cmg01' (cwd None)
>Thread-74::DEBUG::2014-01-24 19:19:40,954::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::DEBUG::2014-01-24 19:19:40,955::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY a250db32-9b39-4533-8bc6-926d4ae17535 /dev/mapper/1cmg01' (cwd None)
>Thread-74::DEBUG::2014-01-24 19:19:41,123::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::DEBUG::2014-01-24 19:19:41,123::lvm::930::Storage.LVM::(createVG) Cache after createvg {'a250db32-9b39-4533-8bc6-926d4ae17535': Stub(name='a250db32-9b39-4533-8bc6-926d4ae17535', stale=True)}
>Thread-74::DEBUG::2014-01-24 19:19:41,124::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:42,484::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:42,489::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::DEBUG::2014-01-24 19:19:43,612::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-74::INFO::2014-01-24 19:19:43,613::logUtils::47::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo'}
>Thread-76::DEBUG::2014-01-24 19:19:43,633::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec]
>Thread-76::INFO::2014-01-24 19:19:43,633::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', domainName='iscsi_0', typeSpecificArg='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', domClass=1, domVersion='0', options=None)
>Thread-76::ERROR::2014-01-24 19:19:43,633::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-76::ERROR::2014-01-24 19:19:43,633::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-76::ERROR::2014-01-24 19:19:43,635::sdc::143::Storage.StorageDomainCache::(_findDomain) domain a250db32-9b39-4533-8bc6-926d4ae17535 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('a250db32-9b39-4533-8bc6-926d4ae17535',)
>Thread-76::INFO::2014-01-24 19:19:43,635::blockSD::492::Storage.StorageDomain::(create) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 domainName=iscsi_0 domClass=1 vgUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo storageType=3 version=0
>Thread-76::DEBUG::2014-01-24 19:19:43,635::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:44,493::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:44,497::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:46,500::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:46,504::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-78::INFO::2014-01-24 19:19:48,343::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-78::INFO::2014-01-24 19:19:48,344::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:19:48,507::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:48,511::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:19:50,513::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:50,518::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:51,548::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:51,551::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:19:51,648::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:51,648::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-76::INFO::2014-01-24 19:19:51,649::blockSD::476::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144)
>Thread-76::DEBUG::2014-01-24 19:19:51,649::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:19:51,779::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:51,781::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:52,521::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:52,525::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:53,983::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:53,984::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-76::DEBUG::2014-01-24 19:19:53,985::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:54,528::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:54,532::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:56,245::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::INFO::2014-01-24 19:19:56,246::blockSD::665::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/1cmg01']
>Thread-76::DEBUG::2014-01-24 19:19:56,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:56,535::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:56,539::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:58,473::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:58,474::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:58,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:19:58,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:58,589::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:58,590::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:19:58,598::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:19:58,599::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:00,551::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:00,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:00,927::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:00,928::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/ids' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:00,936::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:00,936::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:02,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:02,563::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:03,172::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:03,174::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-84::INFO::2014-01-24 19:20:03,836::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-84::INFO::2014-01-24 19:20:03,836::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:20:04,566::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:04,570::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:05,693::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:05,694::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:06,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:06,577::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:07,911::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:07,912::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:07,921::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:07,921::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:08,580::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:08,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:08,756::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:08,756::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:10,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:10,591::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:11,272::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:11,274::blockSD::544::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:11,874::blockSD::544::Storage.Misc.excCmd::(create) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.59533 s, 70.5 MB/s\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:11,874::misc::287::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.59533 s, 70.5 MB/s'], size: 41943040
>Thread-76::DEBUG::2014-01-24 19:20:11,876::blockSD::546::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:11,892::blockSD::546::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0112691 s, 90.9 MB/s\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:11,892::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.0112691 s, 90.9 MB/s'], size: 1024000
>Thread-76::DEBUG::2014-01-24 19:20:11,894::blockSD::548::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:11,908::blockSD::548::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.00981574 s, 104 MB/s\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:11,909::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.00981574 s, 104 MB/s'], size: 1024000
>Thread-76::DEBUG::2014-01-24 19:20:11,909::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-76::DEBUG::2014-01-24 19:20:11,910::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:12,594::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:12,598::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:14,138::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:14,141::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:14,145::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000531357 s, 3.9 MB/s\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:14,145::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000531357 s, 3.9 MB/s'], size: 2048
>Thread-76::DEBUG::2014-01-24 19:20:14,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-76::WARNING::2014-01-24 19:20:14,146::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is
>Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-76::DEBUG::2014-01-24 19:20:14,146::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-76::DEBUG::2014-01-24 19:20:14,148::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-76::DEBUG::2014-01-24 19:20:14,149::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:14,308::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:14,308::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-76::DEBUG::2014-01-24 19:20:14,310::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-76::DEBUG::2014-01-24 19:20:14,315::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000602573 s, 3.4 MB/s\n'; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:14,315::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000602573 s, 3.4 MB/s'], size: 2048
>Thread-76::DEBUG::2014-01-24 19:20:14,315::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-76::DEBUG::2014-01-24 19:20:14,316::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:14,601::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:14,605::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:16,525::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:16,526::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:16,608::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:16,612::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:18,615::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:18,619::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:18,733::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:18,734::clusterlock::65::Storage.Misc.excCmd::(initLock) '/usr/libexec/vdsm/safelease release -f /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 0' (cwd /usr/libexec/vdsm)
>Thread-76::DEBUG::2014-01-24 19:20:18,739::clusterlock::65::Storage.Misc.excCmd::(initLock) SUCCESS: <err> = ''; <rc> = 0
>Thread-76::DEBUG::2014-01-24 19:20:18,739::sd::424::Storage.StorageDomain::(initSPMlease) lease initialized successfully
>Thread-76::DEBUG::2014-01-24 19:20:18,739::hsm::2592::Storage.HSM::(createStorageDomain) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain}
>Thread-76::INFO::2014-01-24 19:20:18,739::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None
>Thread-90::DEBUG::2014-01-24 19:20:18,797::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec]
>Thread-90::INFO::2014-01-24 19:20:18,797::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', options=None)
>Thread-90::DEBUG::2014-01-24 19:20:18,800::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-90::DEBUG::2014-01-24 19:20:18,801::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-90::DEBUG::2014-01-24 19:20:18,806::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000600814 s, 3.4 MB/s\n'; <rc> = 0
>Thread-90::DEBUG::2014-01-24 19:20:18,806::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000600814 s, 3.4 MB/s'], size: 2048
>Thread-90::DEBUG::2014-01-24 19:20:18,806::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-90::DEBUG::2014-01-24 19:20:18,807::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-91::INFO::2014-01-24 19:20:19,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-91::INFO::2014-01-24 19:20:19,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:20:20,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:20,627::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-90::DEBUG::2014-01-24 19:20:21,009::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-90::INFO::2014-01-24 19:20:21,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '86704652288', 'disktotal': '90865401856', 'mdafree': '67105280'}}
>Thread-93::DEBUG::2014-01-24 19:20:21,104::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [33df47ec]
>Thread-93::INFO::2014-01-24 19:20:21,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None)
>Thread-93::INFO::2014-01-24 19:20:21,136::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}}
>Thread-12::DEBUG::2014-01-24 19:20:22,630::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:22,634::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-95::DEBUG::2014-01-24 19:20:22,664::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [2bacde35]
>Thread-95::INFO::2014-01-24 19:20:22,664::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90', 'port': '3260'}], options=None)
>Thread-95::DEBUG::2014-01-24 19:20:22,665::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-95::DEBUG::2014-01-24 19:20:22,675::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-95::DEBUG::2014-01-24 19:20:22,675::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None)
>Thread-95::DEBUG::2014-01-24 19:20:22,685::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-95::DEBUG::2014-01-24 19:20:22,685::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None)
>Thread-95::DEBUG::2014-01-24 19:20:22,693::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-95::DEBUG::2014-01-24 19:20:22,693::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a250db32-9b39-4533-8bc6-926d4ae17535', 'c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '6116a097-264f-40f2-9c37-b0a1d79b1dd2')
>Thread-95::DEBUG::2014-01-24 19:20:22,694::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-95::INFO::2014-01-24 19:20:22,694::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90'}]}
>Thread-96::DEBUG::2014-01-24 19:20:22,715::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3f91059e]
>Thread-96::INFO::2014-01-24 19:20:22,716::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None)
>Thread-96::INFO::2014-01-24 19:20:22,724::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}}
>Thread-97::DEBUG::2014-01-24 19:20:22,767::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3f91059e]
>Thread-97::INFO::2014-01-24 19:20:22,767::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', poolName='datacenter_iscsiTestStorage', masterDom='a250db32-9b39-4533-8bc6-926d4ae17535', domList=['a250db32-9b39-4533-8bc6-926d4ae17535'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None)
>Thread-97::DEBUG::2014-01-24 19:20:22,768::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-97::DEBUG::2014-01-24 19:20:22,768::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:24,637::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:24,641::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:24,856::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:26,644::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:26,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:27,676::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:27,678::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:28,662::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:28,667::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:29,939::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:29,940::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-97::DEBUG::2014-01-24 19:20:29,942::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:29,947::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000480369 s, 4.3 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:29,947::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000480369 s, 4.3 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:29,947::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-97::INFO::2014-01-24 19:20:29,948::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-97::INFO::2014-01-24 19:20:29,948::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-97::INFO::2014-01-24 19:20:29,948::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-97::INFO::2014-01-24 19:20:29,948::blockSD::851::Storage.StorageDomain::(validate) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::DEBUG::2014-01-24 19:20:29,949::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,044::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,045::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,050::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000575052 s, 3.6 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,051::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000575052 s, 3.6 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:30,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-97::INFO::2014-01-24 19:20:30,052::sp::597::Storage.StoragePool::(create) spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 poolName=datacenter_iscsiTestStorage master_sd=a250db32-9b39-4533-8bc6-926d4ae17535 domList=['a250db32-9b39-4533-8bc6-926d4ae17535'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5}
>Thread-97::INFO::2014-01-24 19:20:30,052::blockSD::851::Storage.StorageDomain::(validate) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::DEBUG::2014-01-24 19:20:30,053::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,147::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,149::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,154::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000538097 s, 3.8 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,154::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000538097 s, 3.8 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:30,154::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-97::DEBUG::2014-01-24 19:20:30,156::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,161::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000608133 s, 3.4 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,161::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000608133 s, 3.4 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:30,161::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-97::DEBUG::2014-01-24 19:20:30,162::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-97::DEBUG::2014-01-24 19:20:30,162::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-97::WARNING::2014-01-24 19:20:30,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists
>Thread-97::WARNING::2014-01-24 19:20:30,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists
>Thread-97::DEBUG::2014-01-24 19:20:30,163::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-97::DEBUG::2014-01-24 19:20:30,164::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:30,169::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000528076 s, 3.9 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:30,169::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000528076 s, 3.9 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:30,169::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=e56a04c046252445297cb7b767b0cc21d7da50bd']
>Thread-97::DEBUG::2014-01-24 19:20:30,170::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start a250db32-9b39-4533-8bc6-926d4ae17535 1000 5 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 60000 10000 3"' (cwd /usr/libexec/vdsm)
>Thread-12::DEBUG::2014-01-24 19:20:30,670::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:30,674::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:32,677::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:32,681::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-101::INFO::2014-01-24 19:20:34,585::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-101::INFO::2014-01-24 19:20:34,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:20:34,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:34,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:36,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:36,696::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:38,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:38,709::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:40,712::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:40,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:42,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:42,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:44,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:44,730::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:46,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:46,749::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:48,752::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:48,756::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-107::INFO::2014-01-24 19:20:49,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-107::INFO::2014-01-24 19:20:49,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-97::DEBUG::2014-01-24 19:20:50,192::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::INFO::2014-01-24 19:20:50,192::sp::730::Storage.StoragePool::(createMaster) setting master domain for spUUID 3ea3dad7-383a-417b-b9b7-63ce4660f638 on sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::DEBUG::2014-01-24 19:20:50,192::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,192::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-97::DEBUG::2014-01-24 19:20:50,193::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=781fccff42158744318154713a2298f98a442696']
>Thread-97::DEBUG::2014-01-24 19:20:50,195::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,197::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:50,202::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000555206 s, 3.7 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:50,202::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000555206 s, 3.7 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Regular', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=781fccff42158744318154713a2298f98a442696']
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,203::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-97::DEBUG::2014-01-24 19:20:50,204::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-97::DEBUG::2014-01-24 19:20:50,206::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-97::DEBUG::2014-01-24 19:20:50,206::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1
>Thread-97::DEBUG::2014-01-24 19:20:50,208::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:50,213::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000384443 s, 5.3 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:50,213::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000384443 s, 5.3 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:50,214::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-97::INFO::2014-01-24 19:20:50,214::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::DEBUG::2014-01-24 19:20:50,214::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `a250db32-9b39-4533-8bc6-926d4ae17535`
>Thread-109::DEBUG::2014-01-24 19:20:50,214::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::WARNING::2014-01-24 19:20:50,215::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists
>Thread-109::DEBUG::2014-01-24 19:20:50,219::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:50,225::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:50,230::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000269593 s, 7.6 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:50,230::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000269593 s, 7.6 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:50,231::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-97::DEBUG::2014-01-24 19:20:50,232::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:50,759::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:50,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:20:52,770::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:52,774::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-109::DEBUG::2014-01-24 19:20:53,200::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-109::DEBUG::2014-01-24 19:20:53,202::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-109::DEBUG::2014-01-24 19:20:53,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000530128 s, 7.7 MB/s\n'; <rc> = 0
>Thread-109::DEBUG::2014-01-24 19:20:53,208::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:54,777::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:54,781::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-109::DEBUG::2014-01-24 19:20:55,573::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-109::DEBUG::2014-01-24 19:20:55,575::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain a250db32-9b39-4533-8bc6-926d4ae17535 changed its status to Valid
>Thread-97::DEBUG::2014-01-24 19:20:56,631::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::WARNING::2014-01-24 19:20:56,634::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists
>Thread-97::WARNING::2014-01-24 19:20:56,634::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists
>Thread-97::INFO::2014-01-24 19:20:56,634::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::INFO::2014-01-24 19:20:56,634::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd
>Thread-97::DEBUG::2014-01-24 19:20:56,635::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh a250db32-9b39-4533-8bc6-926d4ae17535' (cwd /usr/libexec/vdsm)
>Thread-12::DEBUG::2014-01-24 19:20:56,784::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:56,788::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:57,651::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:57,653::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-97::DEBUG::2014-01-24 19:20:57,658::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000593483 s, 3.5 MB/s\n'; <rc> = 0
>Thread-97::DEBUG::2014-01-24 19:20:57,658::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000593483 s, 3.5 MB/s'], size: 2048
>Thread-97::DEBUG::2014-01-24 19:20:57,658::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-97::INFO::2014-01-24 19:20:57,658::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-109::DEBUG::2014-01-24 19:20:57,658::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-97::INFO::2014-01-24 19:20:57,659::logUtils::47::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True
>Thread-112::DEBUG::2014-01-24 19:20:57,772::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [60b4788]
>Thread-112::INFO::2014-01-24 19:20:57,773::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', conList=[{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'user': '', 'password': '******', 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90', 'port': '3260'}], options=None)
>Thread-112::DEBUG::2014-01-24 19:20:57,773::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 --op=new' (cwd None)
>Thread-112::DEBUG::2014-01-24 19:20:57,783::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-112::DEBUG::2014-01-24 19:20:57,784::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -l' (cwd None)
>Thread-112::DEBUG::2014-01-24 19:20:57,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-112::DEBUG::2014-01-24 19:20:57,793::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2012-10.brq.str-01:cmestreg -I default -p 10.34.63.202:3260 -n node.startup -v manual --op=update' (cwd None)
>Thread-112::DEBUG::2014-01-24 19:20:57,801::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-112::DEBUG::2014-01-24 19:20:57,801::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a250db32-9b39-4533-8bc6-926d4ae17535', 'c90b62f4-61ad-450d-9ef5-268a6ccb0fc0', '6116a097-264f-40f2-9c37-b0a1d79b1dd2')
>Thread-112::DEBUG::2014-01-24 19:20:57,803::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-112::INFO::2014-01-24 19:20:57,803::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'adf62b39-a744-4f1b-977b-644c29c36c90'}]}
>Thread-113::DEBUG::2014-01-24 19:20:57,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7dd5dbdd]
>Thread-113::INFO::2014-01-24 19:20:57,864::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', options=None)
>Thread-113::DEBUG::2014-01-24 19:20:57,887::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1cmg01' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:58,791::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:20:58,796::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-113::DEBUG::2014-01-24 19:21:00,078::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-113::INFO::2014-01-24 19:21:00,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '90865401856', 'name': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'vgfree': '86704652288', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pvlist': [{'vendorID': 'RH-str01', 'capacity': '90865401856', 'fwrev': '0000', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'devcapacity': '91268055040', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}}
>Thread-115::DEBUG::2014-01-24 19:21:00,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-115::INFO::2014-01-24 19:21:00,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-115::ERROR::2014-01-24 19:21:00,194::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('3ea3dad7-383a-417b-b9b7-63ce4660f638',)", 'code': 309}}
>Thread-116::DEBUG::2014-01-24 19:21:00,234::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-116::INFO::2014-01-24 19:21:00,234::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', hostID=1, msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None)
>Thread-116::INFO::2014-01-24 19:21:00,235::sp::672::Storage.StoragePool::(connect) Connect host #1 to the storage pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 with master domain: a250db32-9b39-4533-8bc6-926d4ae17535 (ver = 1)
>Thread-116::DEBUG::2014-01-24 19:21:00,236::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-116::DEBUG::2014-01-24 19:21:00,236::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:00,799::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:00,803::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:02,406::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:02,806::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:02,811::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:21:04,813::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:04,825::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:05,042::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:05,045::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-118::INFO::2014-01-24 19:21:05,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-118::INFO::2014-01-24 19:21:05,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {}
>Thread-12::DEBUG::2014-01-24 19:21:06,829::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:06,834::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:07,505::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:07,507::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-116::DEBUG::2014-01-24 19:21:07,510::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:07,514::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000553837 s, 3.7 MB/s\n'; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:07,515::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000553837 s, 3.7 MB/s'], size: 2048
>Thread-116::DEBUG::2014-01-24 19:21:07,515::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-116::INFO::2014-01-24 19:21:07,515::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-116::INFO::2014-01-24 19:21:07,516::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-116::INFO::2014-01-24 19:21:07,516::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-116::DEBUG::2014-01-24 19:21:07,516::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1
>Thread-116::DEBUG::2014-01-24 19:21:07,518::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:07,522::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000567966 s, 3.6 MB/s\n'; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:07,522::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000567966 s, 3.6 MB/s'], size: 2048
>Thread-116::DEBUG::2014-01-24 19:21:07,523::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-116::INFO::2014-01-24 19:21:07,523::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-120::DEBUG::2014-01-24 19:21:07,523::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-116::DEBUG::2014-01-24 19:21:07,523::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `a250db32-9b39-4533-8bc6-926d4ae17535`
>Thread-116::WARNING::2014-01-24 19:21:07,524::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists
>Thread-120::DEBUG::2014-01-24 19:21:07,526::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:07,532::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:07,537::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000632904 s, 3.2 MB/s\n'; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:07,538::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000632904 s, 3.2 MB/s'], size: 2048
>Thread-116::DEBUG::2014-01-24 19:21:07,538::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>Thread-116::DEBUG::2014-01-24 19:21:07,539::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:07,626::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:21:07,628::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:07,633::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000554324 s, 7.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:21:07,634::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain a250db32-9b39-4533-8bc6-926d4ae17535 changed its status to Valid
>Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-121::DEBUG::2014-01-24 19:21:07,635::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-122::INFO::2014-01-24 19:21:07,640::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-12::DEBUG::2014-01-24 19:21:08,837::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:08,841::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:21:10,844::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:10,848::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:21:12,851::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:12,855::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:13,621::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-116::WARNING::2014-01-24 19:21:13,624::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists
>Thread-116::WARNING::2014-01-24 19:21:13,624::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists
>Thread-116::INFO::2014-01-24 19:21:13,624::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-116::INFO::2014-01-24 19:21:13,624::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd
>Thread-116::DEBUG::2014-01-24 19:21:13,626::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:13,634::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00346274 s, 1.2 MB/s\n'; <rc> = 0
>Thread-116::INFO::2014-01-24 19:21:13,634::storage_mailbox::387::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8']
>Thread-116::DEBUG::2014-01-24 19:21:13,635::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None)
>Thread-116::DEBUG::2014-01-24 19:21:14,640::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00139 s, 4.1 kB/s\n'; <rc> = 0
>Thread-116::DEBUG::2014-01-24 19:21:14,640::storage_mailbox::209::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638
>Thread-116::DEBUG::2014-01-24 19:21:14,641::sp::491::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 on master domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-116::INFO::2014-01-24 19:21:14,641::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-132::DEBUG::2014-01-24 19:21:14,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-132::INFO::2014-01-24 19:21:14,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-132::INFO::2014-01-24 19:21:14,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}}
>Thread-133::DEBUG::2014-01-24 19:21:14,724::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-133::INFO::2014-01-24 19:21:14,724::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', prevID=-1, prevLVER='-1', maxHostID=250, domVersion='3', options=None)
>Thread-133::INFO::2014-01-24 19:21:14,725::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,730::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,735::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000635366 s, 3.2 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,736::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000635366 s, 3.2 MB/s'], size: 2048
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,736::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:14,736::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:14,736::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,737::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,739::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000535917 s, 3.8 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000535917 s, 3.8 MB/s'], size: 2048
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,744::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:14,745::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start a250db32-9b39-4533-8bc6-926d4ae17535 1 5 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/leases 60000 10000 3"' (cwd /usr/libexec/vdsm)
>Thread-12::DEBUG::2014-01-24 19:21:14,858::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:14,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-134::DEBUG::2014-01-24 19:21:15,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-134::INFO::2014-01-24 19:21:15,752::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-134::INFO::2014-01-24 19:21:15,752::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-135::DEBUG::2014-01-24 19:21:16,761::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-135::INFO::2014-01-24 19:21:16,761::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-135::INFO::2014-01-24 19:21:16,761::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:16,866::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:16,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:21:17,635::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-137::DEBUG::2014-01-24 19:21:17,770::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-137::INFO::2014-01-24 19:21:17,771::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-137::INFO::2014-01-24 19:21:17,771::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-138::DEBUG::2014-01-24 19:21:18,826::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-138::INFO::2014-01-24 19:21:18,827::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-138::INFO::2014-01-24 19:21:18,827::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:18,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:18,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-139::DEBUG::2014-01-24 19:21:19,834::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-139::INFO::2014-01-24 19:21:19,835::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-139::INFO::2014-01-24 19:21:19,835::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:21:19,905::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:21:19,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:19,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060657 s, 6.8 MB/s\n'; <rc> = 0
>Thread-140::INFO::2014-01-24 19:21:20,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-140::INFO::2014-01-24 19:21:20,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00060657', 'lastCheck': '0.5', 'valid': True}}
>Thread-142::DEBUG::2014-01-24 19:21:20,866::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-142::INFO::2014-01-24 19:21:20,867::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-142::INFO::2014-01-24 19:21:20,867::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:20,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:20,885::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-143::DEBUG::2014-01-24 19:21:21,883::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-143::INFO::2014-01-24 19:21:21,883::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-143::INFO::2014-01-24 19:21:21,883::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:22,888::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:22,892::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-144::DEBUG::2014-01-24 19:21:22,903::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-144::INFO::2014-01-24 19:21:22,903::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-144::INFO::2014-01-24 19:21:22,904::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-146::DEBUG::2014-01-24 19:21:23,912::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-146::INFO::2014-01-24 19:21:23,913::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-146::INFO::2014-01-24 19:21:23,913::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:24,895::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:24,899::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-147::DEBUG::2014-01-24 19:21:24,920::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-147::INFO::2014-01-24 19:21:24,921::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-147::INFO::2014-01-24 19:21:24,921::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-148::DEBUG::2014-01-24 19:21:25,929::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-148::INFO::2014-01-24 19:21:25,929::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-148::INFO::2014-01-24 19:21:25,929::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:26,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:26,907::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-150::DEBUG::2014-01-24 19:21:26,959::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-150::INFO::2014-01-24 19:21:26,959::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-150::INFO::2014-01-24 19:21:26,959::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-151::DEBUG::2014-01-24 19:21:27,976::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-151::INFO::2014-01-24 19:21:27,977::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-151::INFO::2014-01-24 19:21:27,977::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:28,909::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:28,914::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-152::DEBUG::2014-01-24 19:21:28,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-152::INFO::2014-01-24 19:21:28,990::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-152::INFO::2014-01-24 19:21:28,990::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:21:29,916::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:29,921::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638998 s, 6.4 MB/s\n'; <rc> = 0
>Thread-154::DEBUG::2014-01-24 19:21:30,012::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-154::INFO::2014-01-24 19:21:30,012::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-154::INFO::2014-01-24 19:21:30,012::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:30,917::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:30,921::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-155::DEBUG::2014-01-24 19:21:31,028::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-155::INFO::2014-01-24 19:21:31,029::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-155::INFO::2014-01-24 19:21:31,029::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-156::DEBUG::2014-01-24 19:21:32,036::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-156::INFO::2014-01-24 19:21:32,037::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-156::INFO::2014-01-24 19:21:32,037::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:32,924::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:32,928::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-158::DEBUG::2014-01-24 19:21:33,044::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-158::INFO::2014-01-24 19:21:33,046::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-158::INFO::2014-01-24 19:21:33,046::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-159::DEBUG::2014-01-24 19:21:34,056::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-159::INFO::2014-01-24 19:21:34,056::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-159::INFO::2014-01-24 19:21:34,057::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,767::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,768::sp::298::Storage.StoragePool::(startSpm) spm lock acquired successfully
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,769::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000498448 s, 4.1 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000498448 s, 4.1 MB/s'], size: 2048
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=ae1553e385473136073f22ecc3ec42bfe3e76c26']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,775::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,776::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,776::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=0', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=04f7a07d85b49c7704704d966d6492eaada87243']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,778::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:21:34,779::sp::462::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `a250db32-9b39-4533-8bc6-926d4ae17535`
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::97::Storage.v3DomainConverter::(v3DomainConverter) Starting conversion for domain a250db32-9b39-4533-8bc6-926d4ae17535 from version 0 to version 3
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::107::Storage.v3DomainConverter::(v3DomainConverter) Upgrading domain a250db32-9b39-4533-8bc6-926d4ae17535 from version 0 to version 2
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::formatConverter::81::Storage.v2DomainConverter::(v2DomainConverter) Trying to upgrade domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata version 2
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,780::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,781::formatConverter::43::Storage.DomainMetadataToTags::(__convertDomainMetadataToTags) Converting domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:34,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:34,931::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:34,936::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-160::DEBUG::2014-01-24 19:21:35,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-160::INFO::2014-01-24 19:21:35,064::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-160::INFO::2014-01-24 19:21:35,064::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-161::INFO::2014-01-24 19:21:35,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-161::INFO::2014-01-24 19:21:35,633::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000638998', 'lastCheck': '5.7', 'valid': True}}
>Thread-163::DEBUG::2014-01-24 19:21:36,072::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-163::INFO::2014-01-24 19:21:36,072::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-163::INFO::2014-01-24 19:21:36,073::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:36,939::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:36,943::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-164::DEBUG::2014-01-24 19:21:37,082::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-164::INFO::2014-01-24 19:21:37,082::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-164::INFO::2014-01-24 19:21:37,082::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,525::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[]
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::WARNING::2014-01-24 19:21:37,526::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,526::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=2', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:37,527::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-165::DEBUG::2014-01-24 19:21:38,090::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-165::INFO::2014-01-24 19:21:38,091::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-165::INFO::2014-01-24 19:21:38,091::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:38,946::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:38,950::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-167::DEBUG::2014-01-24 19:21:39,098::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-167::INFO::2014-01-24 19:21:39,098::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-167::INFO::2014-01-24 19:21:39,099::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:21:39,924::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-168::DEBUG::2014-01-24 19:21:40,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-168::INFO::2014-01-24 19:21:40,139::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-168::INFO::2014-01-24 19:21:40,140::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:40,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:40,958::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-169::DEBUG::2014-01-24 19:21:41,155::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-169::INFO::2014-01-24 19:21:41,155::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-169::INFO::2014-01-24 19:21:41,155::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-171::DEBUG::2014-01-24 19:21:42,170::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-171::INFO::2014-01-24 19:21:42,171::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-171::INFO::2014-01-24 19:21:42,171::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:42,413::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:42,415::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --addtag MDT_VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo --addtag MDT_SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535 --addtag MDT_ROLE=Master --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active --addtag MDT_VERSION=2 --addtag MDT_PV0=pv:1cmg01&44&uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30&44&pestart:0&44&pecount:677&44&mapoffset:0 --addtag MDT_LOCKPOLICY= --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT_CLASS=Data --addtag MDT_DESCRIPTION=iscsi_0 --addtag MDT_LEASETIMESEC=60 --addtag MDT_MASTER_VERSION=1 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_POOL_DESCRIPTION=datacenter_iscsiTestStorage --addtag MDT_POOL_SPM_ID=1 --addtag MDT_TYPE=ISCSI --addtag MDT_LOGBLKSIZE=512 --addtag MDT_LEASERETRIES=3 --addtag MDT_PHYBLKSIZE=512 --addtag MDT_POOL_SPM_LVER=0 --addtag MDT__SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c --addtag MDT_POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:42,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:42,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-172::DEBUG::2014-01-24 19:21:43,179::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-172::INFO::2014-01-24 19:21:43,179::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-172::INFO::2014-01-24 19:21:43,179::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:21:43,332::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:21:43,334::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:43,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000363179 s, 11.3 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,418::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,419::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,419::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,422::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,422::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,424::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000411406 s, 5.0 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000411406 s, 5.0 MB/s'], size: 2048
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,429::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:43,430::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-173::DEBUG::2014-01-24 19:21:44,187::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-173::INFO::2014-01-24 19:21:44,188::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-173::INFO::2014-01-24 19:21:44,188::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:44,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:44,972::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-175::DEBUG::2014-01-24 19:21:45,195::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-175::INFO::2014-01-24 19:21:45,195::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-175::INFO::2014-01-24 19:21:45,196::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,635::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,636::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'VERSION=2', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', '_SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,637::formatConverter::65::Storage.DomainMetadataToTags::(__convertDomainMetadataToTags) Conversion of domain a250db32-9b39-4533-8bc6-926d4ae17535 to tag based metadata completed, target version = 2
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,637::formatConverter::120::Storage.v3DomainConverter::(v3DomainConverter) Initializing the new cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:21:45,726::formatConverter::124::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the host id 1 for domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-176::DEBUG::2014-01-24 19:21:46,202::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-176::INFO::2014-01-24 19:21:46,203::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-176::INFO::2014-01-24 19:21:46,203::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:46,975::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:46,980::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-177::DEBUG::2014-01-24 19:21:47,214::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-177::INFO::2014-01-24 19:21:47,215::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-177::INFO::2014-01-24 19:21:47,215::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-179::DEBUG::2014-01-24 19:21:48,229::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-179::INFO::2014-01-24 19:21:48,229::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-179::INFO::2014-01-24 19:21:48,229::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:48,983::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:48,987::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-180::DEBUG::2014-01-24 19:21:49,237::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-180::INFO::2014-01-24 19:21:49,237::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-180::INFO::2014-01-24 19:21:49,237::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-181::DEBUG::2014-01-24 19:21:50,247::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-181::INFO::2014-01-24 19:21:50,248::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-181::INFO::2014-01-24 19:21:50,248::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-182::INFO::2014-01-24 19:21:50,843::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-182::INFO::2014-01-24 19:21:50,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363179', 'lastCheck': '7.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:21:50,990::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:50,994::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-184::DEBUG::2014-01-24 19:21:51,255::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-184::INFO::2014-01-24 19:21:51,255::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-184::INFO::2014-01-24 19:21:51,256::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-185::DEBUG::2014-01-24 19:21:52,263::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-185::INFO::2014-01-24 19:21:52,264::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-185::INFO::2014-01-24 19:21:52,264::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:52,997::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:53,002::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-186::DEBUG::2014-01-24 19:21:53,273::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-186::INFO::2014-01-24 19:21:53,273::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-186::INFO::2014-01-24 19:21:53,274::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:21:53,343::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:21:53,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605733 s, 6.8 MB/s\n'; <rc> = 0
>Thread-188::DEBUG::2014-01-24 19:21:54,299::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-188::INFO::2014-01-24 19:21:54,300::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-188::INFO::2014-01-24 19:21:54,300::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:55,005::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:55,009::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-189::DEBUG::2014-01-24 19:21:55,307::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-189::INFO::2014-01-24 19:21:55,308::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-189::INFO::2014-01-24 19:21:55,308::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-190::DEBUG::2014-01-24 19:21:56,333::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-190::INFO::2014-01-24 19:21:56,333::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-190::INFO::2014-01-24 19:21:56,333::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:57,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:57,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-192::DEBUG::2014-01-24 19:21:57,348::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-192::INFO::2014-01-24 19:21:57,348::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-192::INFO::2014-01-24 19:21:57,348::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-193::DEBUG::2014-01-24 19:21:58,377::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-193::INFO::2014-01-24 19:21:58,377::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-193::INFO::2014-01-24 19:21:58,377::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:21:59,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:21:59,024::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-194::DEBUG::2014-01-24 19:21:59,408::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-194::INFO::2014-01-24 19:21:59,408::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-194::INFO::2014-01-24 19:21:59,409::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-196::DEBUG::2014-01-24 19:22:00,416::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-196::INFO::2014-01-24 19:22:00,416::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-196::INFO::2014-01-24 19:22:00,416::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:01,027::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:01,031::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-197::DEBUG::2014-01-24 19:22:01,427::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-197::INFO::2014-01-24 19:22:01,427::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-197::INFO::2014-01-24 19:22:01,427::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-198::DEBUG::2014-01-24 19:22:02,435::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-198::INFO::2014-01-24 19:22:02,435::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-198::INFO::2014-01-24 19:22:02,435::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:03,034::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:03,039::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:03,351::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:03,356::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636078 s, 6.4 MB/s\n'; <rc> = 0
>Thread-200::DEBUG::2014-01-24 19:22:03,442::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-200::INFO::2014-01-24 19:22:03,443::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-200::INFO::2014-01-24 19:22:03,443::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-201::DEBUG::2014-01-24 19:22:04,450::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-201::INFO::2014-01-24 19:22:04,450::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-201::INFO::2014-01-24 19:22:04,450::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:05,042::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:05,046::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-202::DEBUG::2014-01-24 19:22:05,470::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-202::INFO::2014-01-24 19:22:05,470::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-202::INFO::2014-01-24 19:22:05,471::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-203::INFO::2014-01-24 19:22:06,092::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-203::INFO::2014-01-24 19:22:06,092::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 2, 'acquired': True, 'delay': '0.000636078', 'lastCheck': '2.7', 'valid': True}}
>Thread-205::DEBUG::2014-01-24 19:22:06,479::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-205::INFO::2014-01-24 19:22:06,479::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-205::INFO::2014-01-24 19:22:06,479::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,729::formatConverter::201::Storage.v3DomainConverter::(v3DomainConverter) Acquiring the cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535 with host id: 1
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,792::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,887::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::formatConverter::167::Storage.v3DomainConverter::(v3ReallocateMetadataSlot) Starting metadata reallocation check for domain a250db32-9b39-4533-8bc6-926d4ae17535 with metaMaxSlot 1947 (leases volume size 2048)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::formatConverter::306::Storage.v3DomainConverter::(v3DomainConverter) Finalizing the storage domain upgrade from version 2 to version 3 for domain a250db32-9b39-4533-8bc6-926d4ae17535
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,891::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,892::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:06,892::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:07,049::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:07,054::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-206::DEBUG::2014-01-24 19:22:07,489::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-206::INFO::2014-01-24 19:22:07,490::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-206::INFO::2014-01-24 19:22:07,490::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-207::DEBUG::2014-01-24 19:22:08,505::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-207::INFO::2014-01-24 19:22:08,506::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-207::INFO::2014-01-24 19:22:08,506::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,045::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,047::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT__SHA_CKSUM=b06c7fcf24cd4fdfa471e889197ab78982bcf80c --deltag MDT_VERSION=2 --addtag MDT_VERSION=3 --addtag MDT__SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:09,057::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:09,063::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,228::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,229::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:09,229::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh a250db32-9b39-4533-8bc6-926d4ae17535' (cwd /usr/libexec/vdsm)
>Thread-209::DEBUG::2014-01-24 19:22:09,513::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-209::INFO::2014-01-24 19:22:09,513::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-209::INFO::2014-01-24 19:22:09,513::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,245::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,245::formatConverter::344::Storage.v3DomainConverter::(v3DomainConverter) Switching the cluster lock for domain a250db32-9b39-4533-8bc6-926d4ae17535
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:10,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-210::DEBUG::2014-01-24 19:22:10,521::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-210::INFO::2014-01-24 19:22:10,521::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-210::INFO::2014-01-24 19:22:10,522::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:11,068::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:11,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-211::DEBUG::2014-01-24 19:22:11,528::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-211::INFO::2014-01-24 19:22:11,529::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-211::INFO::2014-01-24 19:22:11,529::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-213::DEBUG::2014-01-24 19:22:12,536::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-213::INFO::2014-01-24 19:22:12,536::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-213::INFO::2014-01-24 19:22:12,536::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:13,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:13,080::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-214::DEBUG::2014-01-24 19:22:13,574::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-214::INFO::2014-01-24 19:22:13,574::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-214::INFO::2014-01-24 19:22:13,574::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-215::DEBUG::2014-01-24 19:22:14,601::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-215::INFO::2014-01-24 19:22:14,601::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-215::INFO::2014-01-24 19:22:14,601::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,969::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,970::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,972::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,977::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000639183 s, 3.2 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000639183 s, 3.2 MB/s'], size: 2048
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,978::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:14,979::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:15,083::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:15,088::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-217::DEBUG::2014-01-24 19:22:15,639::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-217::INFO::2014-01-24 19:22:15,639::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-217::INFO::2014-01-24 19:22:15,639::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-218::DEBUG::2014-01-24 19:22:16,654::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-218::INFO::2014-01-24 19:22:16,654::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-218::INFO::2014-01-24 19:22:16,654::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:17,091::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:17,095::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,600::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,601::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::INFO::2014-01-24 19:22:17,601::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,604::sp::467::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade
>Thread-120::DEBUG::2014-01-24 19:22:17,606::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:17,612::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-219::DEBUG::2014-01-24 19:22:17,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-219::INFO::2014-01-24 19:22:17,663::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-219::INFO::2014-01-24 19:22:17,664::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-120::DEBUG::2014-01-24 19:22:17,703::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:17,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:17,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600893 s, 6.8 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:17,711::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-221::DEBUG::2014-01-24 19:22:18,671::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-221::INFO::2014-01-24 19:22:18,671::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-221::INFO::2014-01-24 19:22:18,671::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:19,098::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:19,102::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-222::DEBUG::2014-01-24 19:22:19,678::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-222::INFO::2014-01-24 19:22:19,679::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-222::INFO::2014-01-24 19:22:19,679::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,654::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,655::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,656::sp::474::Storage.StoragePool::(_upgradePool) Registering with state change event
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,656::sp::477::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,657::blockSD::1137::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>Thread-223::DEBUG::2014-01-24 19:22:20,695::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-223::INFO::2014-01-24 19:22:20,696::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-223::INFO::2014-01-24 19:22:20,696::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,698::blockSD::1137::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,699::blockSD::1162::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,707::blockSD::1162::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,708::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/a250db32-9b39-4533-8bc6-926d4ae17535/master /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,724::blockSD::1174::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,736::blockSD::1174::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,736::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master/vms
>Thread-120::DEBUG::2014-01-24 19:22:20,750::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,824::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/master/tasks
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:20,827::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:21,105::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:21,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-224::INFO::2014-01-24 19:22:21,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-224::INFO::2014-01-24 19:22:21,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 2, 'acquired': True, 'delay': '0.000636078', 'lastCheck': '18.0', 'valid': True}}
>Thread-226::DEBUG::2014-01-24 19:22:21,704::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-226::INFO::2014-01-24 19:22:21,704::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-226::INFO::2014-01-24 19:22:21,704::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-227::DEBUG::2014-01-24 19:22:22,711::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-227::INFO::2014-01-24 19:22:22,712::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-227::INFO::2014-01-24 19:22:22,712::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-12::DEBUG::2014-01-24 19:22:23,116::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:23,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,208::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,209::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,211::storage_mailbox::576::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1']
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,212::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None)
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,247::storage_mailbox::86::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306956 s, 33.4 MB/s\n'; <rc> = 0
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,248::storage_mailbox::584::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,248::sp::349::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 3ea3dad7-383a-417b-b9b7-63ce4660f638 on master domain a250db32-9b39-4533-8bc6-926d4ae17535
>7b3a2539-c588-43a7-bae8-d17f44cd8b69::DEBUG::2014-01-24 19:22:23,249::sp::357::Storage.StoragePool::(startSpm) ended.
>Dummy-233::DEBUG::2014-01-24 19:22:23,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:23,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284332 s, 36.0 MB/s\n'; <rc> = 0
>Thread-234::DEBUG::2014-01-24 19:22:23,719::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-234::INFO::2014-01-24 19:22:23,719::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-234::INFO::2014-01-24 19:22:23,719::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '7b3a2539-c588-43a7-bae8-d17f44cd8b69'}}
>Thread-235::DEBUG::2014-01-24 19:22:23,726::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-235::INFO::2014-01-24 19:22:23,727::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-235::INFO::2014-01-24 19:22:23,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-236::DEBUG::2014-01-24 19:22:23,739::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-236::INFO::2014-01-24 19:22:23,740::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='7b3a2539-c588-43a7-bae8-d17f44cd8b69', spUUID=None, options=None)
>Thread-236::INFO::2014-01-24 19:22:23,740::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Thread-237::DEBUG::2014-01-24 19:22:23,840::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-237::INFO::2014-01-24 19:22:23,840::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-237::INFO::2014-01-24 19:22:23,842::sp::1060::Storage.StoragePool::(activateSD) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638
>Thread-237::INFO::2014-01-24 19:22:23,842::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None
>Thread-238::DEBUG::2014-01-24 19:22:23,899::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [51fb5716]
>Thread-238::INFO::2014-01-24 19:22:23,899::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', hostID=1, msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None)
>Thread-238::DEBUG::2014-01-24 19:22:23,901::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-238::DEBUG::2014-01-24 19:22:23,901::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:25,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:25,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:25,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:25,366::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266606 s, 38.4 MB/s\n'; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:25,999::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:27,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:27,141::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:27,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:27,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270166 s, 37.9 MB/s\n'; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:28,576::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:28,578::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:29,144::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:29,150::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:29,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:29,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269229 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:31,153::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:31,158::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:31,171::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:31,172::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-238::DEBUG::2014-01-24 19:22:31,174::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-238::DEBUG::2014-01-24 19:22:31,179::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000440661 s, 4.6 MB/s\n'; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:31,179::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000440661 s, 4.6 MB/s'], size: 2048
>Thread-238::DEBUG::2014-01-24 19:22:31,180::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-238::DEBUG::2014-01-24 19:22:31,180::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-238::DEBUG::2014-01-24 19:22:31,181::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:31,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:31,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246913 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:33,161::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:33,166::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:33,372::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:33,373::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', '_SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979']
>Thread-238::INFO::2014-01-24 19:22:33,373::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-238::INFO::2014-01-24 19:22:33,373::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-238::INFO::2014-01-24 19:22:33,373::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-238::DEBUG::2014-01-24 19:22:33,374::sp::1472::Storage.StoragePool::(setMasterDomain) Master domain a250db32-9b39-4533-8bc6-926d4ae17535 verified, version 1
>Thread-238::WARNING::2014-01-24 19:22:33,376::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638 already exists
>Thread-120::DEBUG::2014-01-24 19:22:33,377::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-238::DEBUG::2014-01-24 19:22:33,383::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:33,473::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:33,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:33,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543345 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:33,561::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:33,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274285 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:35,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:35,174::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:35,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:35,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027052 s, 37.9 MB/s\n'; <rc> = 0
>Thread-243::INFO::2014-01-24 19:22:36,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-243::INFO::2014-01-24 19:22:36,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543345', 'lastCheck': '3.1', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:22:37,177::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:37,182::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:37,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:37,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265041 s, 38.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:39,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:39,190::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::DEBUG::2014-01-24 19:22:39,317::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-238::WARNING::2014-01-24 19:22:39,320::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images already exists
>Thread-238::WARNING::2014-01-24 19:22:39,320::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/dom_md already exists
>Thread-238::INFO::2014-01-24 19:22:39,320::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-238::INFO::2014-01-24 19:22:39,321::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535 to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd
>Thread-238::INFO::2014-01-24 19:22:39,322::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Dummy-233::DEBUG::2014-01-24 19:22:39,749::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:39,801::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270697 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:41,193::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:41,199::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:41,810::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:41,863::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274874 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:43,201::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:43,207::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:43,486::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:43,492::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664273 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:43,872::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-247::DEBUG::2014-01-24 19:22:43,887::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-247::INFO::2014-01-24 19:22:43,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-247::INFO::2014-01-24 19:22:43,888::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-248::DEBUG::2014-01-24 19:22:43,897::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-248::INFO::2014-01-24 19:22:43,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-248::INFO::2014-01-24 19:22:43,898::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:22:43,926::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289445 s, 35.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:45,210::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:45,215::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:45,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:45,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274034 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:47,218::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:47,223::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:47,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:48,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027211 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:49,226::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:49,231::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:50,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:50,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247897 s, 41.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:51,234::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:51,239::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-251::INFO::2014-01-24 19:22:51,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-251::INFO::2014-01-24 19:22:51,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664273', 'lastCheck': '8.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:22:52,120::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:52,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269084 s, 38.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:53,242::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:53,247::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:22:53,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:22:53,506::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000643507 s, 6.4 MB/s\n'; <rc> = 0
>Thread-253::DEBUG::2014-01-24 19:22:53,933::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-253::INFO::2014-01-24 19:22:53,934::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-253::INFO::2014-01-24 19:22:53,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-254::DEBUG::2014-01-24 19:22:53,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-254::INFO::2014-01-24 19:22:53,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-254::INFO::2014-01-24 19:22:53,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:22:54,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:54,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277389 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:55,249::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:55,255::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:56,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:56,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242229 s, 42.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:57,257::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:57,263::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:22:58,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:22:58,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276842 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:22:59,265::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:22:59,270::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:00,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:00,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272544 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:01,273::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:01,278::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:02,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:02,480::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272904 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:03,281::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:03,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:03,511::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:03,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593579 s, 6.9 MB/s\n'; <rc> = 0
>Thread-259::DEBUG::2014-01-24 19:23:03,970::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-259::INFO::2014-01-24 19:23:03,971::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-259::INFO::2014-01-24 19:23:03,971::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-260::DEBUG::2014-01-24 19:23:03,979::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-260::INFO::2014-01-24 19:23:03,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-260::INFO::2014-01-24 19:23:03,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:23:04,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:04,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269734 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:05,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:05,294::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:06,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:06,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270842 s, 37.8 MB/s\n'; <rc> = 0
>Thread-261::INFO::2014-01-24 19:23:06,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-261::INFO::2014-01-24 19:23:06,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593579', 'lastCheck': '3.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:23:07,299::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:07,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:08,372::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-263::INFO::2014-01-24 19:23:08,373::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={})
>Thread-263::DEBUG::2014-01-24 19:23:08,373::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-263::DEBUG::2014-01-24 19:23:08,373::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:08,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:08,658::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245903 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:09,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:09,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:10,440::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:10,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:10,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248931 s, 41.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:11,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:11,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:12,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:12,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271153 s, 37.8 MB/s\n'; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:13,247::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:13,250::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:13,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:13,336::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:13,520::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-266::DEBUG::2014-01-24 19:23:14,033::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-266::INFO::2014-01-24 19:23:14,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-266::INFO::2014-01-24 19:23:14,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-267::DEBUG::2014-01-24 19:23:14,061::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-267::INFO::2014-01-24 19:23:14,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-267::DEBUG::2014-01-24 19:23:14,062::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:14,789::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:14,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248551 s, 41.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:15,339::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:15,344::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:15,673::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:15,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:15,683::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619241 s, 6.6 MB/s\n'; <rc> = 0
>Thread-267::DEBUG::2014-01-24 19:23:16,223::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-267::INFO::2014-01-24 19:23:16,224::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:23:16,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:16,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239541 s, 42.7 MB/s\n'; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:17,312::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:17,347::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:17,353::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:17,716::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/3514f0c54d5c01d2d /dev/mapper/3514f0c54d5c01d5f /dev/mapper/1cmg02 /dev/mapper/1cmg01' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:18,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:18,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272948 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:19,356::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:19,361::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:20,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:21,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245202 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:21,364::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:21,369::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-270::INFO::2014-01-24 19:23:22,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-270::INFO::2014-01-24 19:23:22,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619241', 'lastCheck': '6.5', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:23:23,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:23,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248495 s, 41.2 MB/s\n'; <rc> = 0
>Thread-263::DEBUG::2014-01-24 19:23:23,109::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff\n  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff\n  Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff\n  Can\'t initialize physical volume "/dev/mapper/1cmg01" of volume group "a250db32-9b39-4533-8bc6-926d4ae17535" without -ff\n'; <rc> = 5
>Thread-263::DEBUG::2014-01-24 19:23:23,110::lvm::859::Storage.LVM::(testPVCreate) rc: 5, out: [], err: ['  TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', '  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d2d" of volume group "d3d63d8c-3700-412c-9dc7-5e57c8b65835" without -ff', '  Can\'t initialize physical volume "/dev/mapper/3514f0c54d5c01d5f" of volume group "c90b62f4-61ad-450d-9ef5-268a6ccb0fc0" without -ff', '  Can\'t initialize physical volume "/dev/mapper/1cmg02" of volume group "6116a097-264f-40f2-9c37-b0a1d79b1dd2" without -ff', '  Can\'t initialize physical volume "/dev/mapper/1cmg01" of volume group "a250db32-9b39-4533-8bc6-926d4ae17535" without -ff'], unusedDevs: set([]), usedDevs: set(['/dev/mapper/1cmg01', '/dev/mapper/3514f0c54d5c01d5f', '/dev/mapper/3514f0c54d5c01d2d', '/dev/mapper/1cmg02'])
>Thread-263::INFO::2014-01-24 19:23:23,111::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ycYoMs-BCcs-Lkul-v2GF-V6Fy-Mbhr-LPcWAG', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'vEIhYh-t64d-rixc-zdaH-is3J-JAbn-m1ju94', 'serial': 'SXtremIO_XtremApp_92c6101061464169b0001027fc728e1b', 'GUID': '3514f0c54d5c01d2d', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'XtremIO', 'capacity': '53687091200', 'fwrev': '1.05', 'vgUUID': 'ZO5XUI-KVa3-uvqI-K5ip-7zHm-xI9j-dNhA0P', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.7', 'iqn': 'iqn.2008-05.com.xtremio:001e675b8ee0', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'TISsCt-PRFo-aQdO-dyEe-hZG2-M4d7-LOQYJJ', 'serial': 'SXtremIO_XtremApp_91838d02999c45b98b74def227cb4b50', 'GUID': '3514f0c54d5c01d5f', 'productID': 'XtremApp'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '102005473280', 'fwrev': '0001', 'vgUUID': '2jFAnJ-0eb2-p5Jy-Qs3w-bOiW-oTPk-4o7Wcu', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'JjZ782-Z9MT-EaGF-ifdA-vAq5-5DBA-XAccgF', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg02', 'productID': 'VIRTUAL-DISK'}, {'status': 'used', 'vendorID': 'RH-str01', 'capacity': '91268055040', 'fwrev': '0001', 'vgUUID': '0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.63.202', 'iqn': 'iqn.2012-10.brq.str-01:cmestreg', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30', 'serial': 'SRH-str01VIRTUAL-DISK', 'GUID': '1cmg01', 'productID': 'VIRTUAL-DISK'}]}
>Thread-12::DEBUG::2014-01-24 19:23:23,372::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:23,377::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:25,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:25,141::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273659 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:25,380::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:25,385::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:25,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:25,694::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000747024 s, 5.5 MB/s\n'; <rc> = 0
>Thread-273::DEBUG::2014-01-24 19:23:26,281::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-273::INFO::2014-01-24 19:23:26,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-273::INFO::2014-01-24 19:23:26,282::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-274::DEBUG::2014-01-24 19:23:26,309::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-274::INFO::2014-01-24 19:23:26,309::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-274::INFO::2014-01-24 19:23:26,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:23:27,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:27,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271909 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:27,388::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:27,393::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:29,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:29,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242708 s, 42.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:29,396::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:29,401::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:31,271::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:31,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02701 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:31,404::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:31,409::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:33,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:33,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272319 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:33,411::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:33,417::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:35,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:35,419::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:35,429::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:35,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457668 s, 22.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:35,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:35,704::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663414 s, 6.2 MB/s\n'; <rc> = 0
>Thread-278::DEBUG::2014-01-24 19:23:36,402::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-278::INFO::2014-01-24 19:23:36,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-278::INFO::2014-01-24 19:23:36,402::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-279::DEBUG::2014-01-24 19:23:36,409::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-279::INFO::2014-01-24 19:23:36,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-279::INFO::2014-01-24 19:23:36,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Thread-280::INFO::2014-01-24 19:23:37,400::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-280::INFO::2014-01-24 19:23:37,400::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663414', 'lastCheck': '1.7', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:23:37,441::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:37,446::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:37,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:37,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271602 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:39,449::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:39,454::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:39,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:39,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274433 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:41,457::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:41,462::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:41,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:41,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278595 s, 36.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:43,465::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:43,470::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:43,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:43,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024553 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:45,473::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:45,478::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:45,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:45,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665626 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:45,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:45,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02716 s, 37.7 MB/s\n'; <rc> = 0
>Thread-284::DEBUG::2014-01-24 19:23:46,506::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-284::INFO::2014-01-24 19:23:46,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-284::INFO::2014-01-24 19:23:46,507::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-285::DEBUG::2014-01-24 19:23:46,534::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-285::INFO::2014-01-24 19:23:46,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-285::INFO::2014-01-24 19:23:46,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Thread-12::DEBUG::2014-01-24 19:23:47,481::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:47,486::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:47,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:47,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027529 s, 37.2 MB/s\n'; <rc> = 0
>Thread-287::DEBUG::2014-01-24 19:23:48,093::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7099245d]
>Thread-287::INFO::2014-01-24 19:23:48,094::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None)
>Thread-287::DEBUG::2014-01-24 19:23:48,096::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None)
>Thread-287::DEBUG::2014-01-24 19:23:48,219::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-287::DEBUG::2014-01-24 19:23:48,221::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a0e1b6de-824a-4543-8c86-adc34e634cee',)
>Thread-287::DEBUG::2014-01-24 19:23:48,221::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-287::INFO::2014-01-24 19:23:48,221::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}
>Thread-288::DEBUG::2014-01-24 19:23:48,678::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3e3de33c]
>Thread-288::INFO::2014-01-24 19:23:48,678::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b', 'port': ''}], options=None)
>Thread-288::DEBUG::2014-01-24 19:23:48,680::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-288::DEBUG::2014-01-24 19:23:48,681::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('a0e1b6de-824a-4543-8c86-adc34e634cee',)
>Thread-288::DEBUG::2014-01-24 19:23:48,681::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-288::INFO::2014-01-24 19:23:48,681::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b'}]}
>Thread-289::DEBUG::2014-01-24 19:23:48,727::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3e3de33c]
>Thread-289::INFO::2014-01-24 19:23:48,727::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='619e3a48-8138-49c4-a8c6-4e218c033c95', domainName='export', typeSpecificArg='10.34.63.199:/cmg01', domClass=3, domVersion='0', options=None)
>Thread-289::DEBUG::2014-01-24 19:23:48,727::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-289::DEBUG::2014-01-24 19:23:48,727::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:49,489::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:49,494::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:49,842::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:49,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024266 s, 42.2 MB/s\n'; <rc> = 0
>Thread-289::DEBUG::2014-01-24 19:23:50,830::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:51,497::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:51,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:51,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:51,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274553 s, 37.3 MB/s\n'; <rc> = 0
>Thread-291::INFO::2014-01-24 19:23:52,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-291::INFO::2014-01-24 19:23:52,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000665626', 'lastCheck': '6.9', 'valid': True}}
>Thread-289::DEBUG::2014-01-24 19:23:53,301::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-289::ERROR::2014-01-24 19:23:53,303::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 619e3a48-8138-49c4-a8c6-4e218c033c95
>Thread-289::ERROR::2014-01-24 19:23:53,303::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 619e3a48-8138-49c4-a8c6-4e218c033c95
>Thread-289::DEBUG::2014-01-24 19:23:53,304::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 619e3a48-8138-49c4-a8c6-4e218c033c95' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:53,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:53,513::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:53,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:54,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274988 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:23:55,517::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:55,522::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:55,719::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:56,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:23:56,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248273 s, 41.2 MB/s\n'; <rc> = 0
>Thread-289::DEBUG::2014-01-24 19:23:56,451::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "619e3a48-8138-49c4-a8c6-4e218c033c95" not found\n  Skipping volume group 619e3a48-8138-49c4-a8c6-4e218c033c95\n'; <rc> = 5
>Thread-289::WARNING::2014-01-24 19:23:56,452::lvm::377::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "619e3a48-8138-49c4-a8c6-4e218c033c95" not found', '  Skipping volume group 619e3a48-8138-49c4-a8c6-4e218c033c95']
>Thread-289::ERROR::2014-01-24 19:23:56,537::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 619e3a48-8138-49c4-a8c6-4e218c033c95 not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('619e3a48-8138-49c4-a8c6-4e218c033c95',)
>Thread-289::INFO::2014-01-24 19:23:56,537::nfsSD::69::Storage.StorageDomain::(create) sdUUID=619e3a48-8138-49c4-a8c6-4e218c033c95 domainName=export remotePath=10.34.63.199:/cmg01 domClass=3
>Thread-289::ERROR::2014-01-24 19:23:56,634::dispatcher::67::Storage.Dispatcher.Protect::(run) {'status': {'message': "Storage domain is not empty - requires cleaning: ('10.34.63.199:/cmg01',)", 'code': 361}}
>Thread-295::DEBUG::2014-01-24 19:23:56,686::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-295::INFO::2014-01-24 19:23:56,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-295::INFO::2014-01-24 19:23:56,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-296::DEBUG::2014-01-24 19:23:56,713::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-296::INFO::2014-01-24 19:23:56,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-296::DEBUG::2014-01-24 19:23:56,715::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-297::DEBUG::2014-01-24 19:23:57,063::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [235f0344]
>Thread-297::INFO::2014-01-24 19:23:57,064::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b', 'port': ''}], options=None)
>Thread-297::DEBUG::2014-01-24 19:23:57,064::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None)
>Thread-297::DEBUG::2014-01-24 19:23:57,091::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-297::DEBUG::2014-01-24 19:23:57,091::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:57,525::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:57,531::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:58,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:58,091::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:23:58,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:23:58,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000419461 s, 9.8 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:23:58,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396205 s, 25.8 MB/s\n'; <rc> = 0
>Thread-296::DEBUG::2014-01-24 19:23:59,092::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-296::INFO::2014-01-24 19:23:59,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Thread-297::DEBUG::2014-01-24 19:23:59,499::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:59,534::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:23:59,539::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:00,159::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:00,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276497 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:01,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:01,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-297::DEBUG::2014-01-24 19:24:02,136::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-297::INFO::2014-01-24 19:24:02,137::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '69f144cb-6e90-44a0-a3fe-13254312ae7b'}]}
>Dummy-233::DEBUG::2014-01-24 19:24:02,221::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:02,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272615 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:03,550::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:03,556::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:04,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:04,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276728 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:05,559::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:05,564::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:06,346::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:06,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266756 s, 38.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:07,568::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:07,575::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-301::INFO::2014-01-24 19:24:07,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-301::INFO::2014-01-24 19:24:07,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419461', 'lastCheck': '9.7', 'valid': True}}
>Thread-120::DEBUG::2014-01-24 19:24:08,118::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:08,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:08,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248043 s, 41.3 MB/s\n'; <rc> = 0
>Thread-303::DEBUG::2014-01-24 19:24:09,122::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-303::INFO::2014-01-24 19:24:09,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-303::INFO::2014-01-24 19:24:09,123::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-304::DEBUG::2014-01-24 19:24:09,129::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-304::INFO::2014-01-24 19:24:09,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-304::DEBUG::2014-01-24 19:24:09,130::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:09,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:09,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:10,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:10,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271103 s, 37.8 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:11,038::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:11,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:11,049::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000710438 s, 5.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:11,587::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:11,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-304::DEBUG::2014-01-24 19:24:11,978::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-304::INFO::2014-01-24 19:24:11,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:24:12,530::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:12,583::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269194 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:13,597::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:13,603::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:14,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:14,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0240792 s, 42.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:15,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:15,610::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:16,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:16,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246655 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:17,615::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:17,622::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:18,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:18,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269518 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:19,624::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:19,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:20,776::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:20,829::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276404 s, 37.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:21,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:21,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628724 s, 6.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:21,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:21,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-309::DEBUG::2014-01-24 19:24:22,085::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-309::INFO::2014-01-24 19:24:22,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-309::INFO::2014-01-24 19:24:22,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-310::DEBUG::2014-01-24 19:24:22,091::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-310::INFO::2014-01-24 19:24:22,092::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-310::INFO::2014-01-24 19:24:22,093::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:24:22,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:22,891::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273878 s, 37.4 MB/s\n'; <rc> = 0
>Thread-311::INFO::2014-01-24 19:24:23,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-311::INFO::2014-01-24 19:24:23,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000628724', 'lastCheck': '2.0', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:24:23,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:23,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:24,901::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:24,954::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277085 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:25,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:25,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:26,963::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:27,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272714 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:27,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:27,661::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:29,025::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:29,075::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024522 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:29,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:29,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:31,068::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:31,074::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000582508 s, 7.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:31,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:31,136::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266711 s, 38.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:31,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:31,678::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-315::DEBUG::2014-01-24 19:24:32,145::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-315::INFO::2014-01-24 19:24:32,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-315::INFO::2014-01-24 19:24:32,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-316::DEBUG::2014-01-24 19:24:32,154::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-316::INFO::2014-01-24 19:24:32,154::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-316::INFO::2014-01-24 19:24:32,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Dummy-233::DEBUG::2014-01-24 19:24:33,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:33,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272463 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:33,681::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:33,686::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-318::DEBUG::2014-01-24 19:24:35,035::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1faa93b]
>Thread-318::INFO::2014-01-24 19:24:35,036::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': ''}], options=None)
>Thread-318::DEBUG::2014-01-24 19:24:35,037::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None)
>Thread-318::DEBUG::2014-01-24 19:24:35,079::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-318::DEBUG::2014-01-24 19:24:35,080::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-318::DEBUG::2014-01-24 19:24:35,081::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-318::INFO::2014-01-24 19:24:35,081::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]}
>Dummy-233::DEBUG::2014-01-24 19:24:35,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-320::DEBUG::2014-01-24 19:24:35,261::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a]
>Thread-320::INFO::2014-01-24 19:24:35,263::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None)
>Thread-320::DEBUG::2014-01-24 19:24:35,273::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-320::DEBUG::2014-01-24 19:24:35,275::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-320::DEBUG::2014-01-24 19:24:35,276::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-320::INFO::2014-01-24 19:24:35,276::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]}
>Dummy-233::DEBUG::2014-01-24 19:24:35,285::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032559 s, 31.5 MB/s\n'; <rc> = 0
>Thread-321::DEBUG::2014-01-24 19:24:35,290::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a]
>Thread-321::INFO::2014-01-24 19:24:35,291::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=1, sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', domainName='export', typeSpecificArg='10.34.63.199:/cmg01', domClass=3, domVersion='0', options=None)
>Thread-321::DEBUG::2014-01-24 19:24:35,293::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-321::DEBUG::2014-01-24 19:24:35,293::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:35,689::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:35,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:37,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:37,357::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274163 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:37,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:37,703::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-321::DEBUG::2014-01-24 19:24:38,061::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-322::INFO::2014-01-24 19:24:38,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-322::INFO::2014-01-24 19:24:38,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582508', 'lastCheck': '7.2', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:24:39,367::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:39,419::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272791 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:39,706::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:39,717::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:41,079::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:41,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00056434 s, 7.3 MB/s\n'; <rc> = 0
>Thread-321::DEBUG::2014-01-24 19:24:41,234::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-321::ERROR::2014-01-24 19:24:41,235::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-321::ERROR::2014-01-24 19:24:41,235::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-321::DEBUG::2014-01-24 19:24:41,236::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 464da998-ebd2-46a1-bab0-1c02a21a165e' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:41,429::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:41,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267442 s, 38.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:41,720::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:41,725::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-325::DEBUG::2014-01-24 19:24:42,181::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-325::INFO::2014-01-24 19:24:42,182::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-325::INFO::2014-01-24 19:24:42,182::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-326::DEBUG::2014-01-24 19:24:42,188::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-326::INFO::2014-01-24 19:24:42,188::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-326::DEBUG::2014-01-24 19:24:42,189::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:43,491::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:43,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264913 s, 38.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:43,728::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:43,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-321::DEBUG::2014-01-24 19:24:44,302::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = '  Volume group "464da998-ebd2-46a1-bab0-1c02a21a165e" not found\n  Skipping volume group 464da998-ebd2-46a1-bab0-1c02a21a165e\n'; <rc> = 5
>Thread-321::WARNING::2014-01-24 19:24:44,303::lvm::377::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] ['  Volume group "464da998-ebd2-46a1-bab0-1c02a21a165e" not found', '  Skipping volume group 464da998-ebd2-46a1-bab0-1c02a21a165e']
>Thread-321::ERROR::2014-01-24 19:24:44,305::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 464da998-ebd2-46a1-bab0-1c02a21a165e not found
>Traceback (most recent call last):
>  File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>    dom = findMethod(sdUUID)
>  File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain
>    raise se.StorageDomainDoesNotExist(sdUUID)
>StorageDomainDoesNotExist: Storage domain does not exist: ('464da998-ebd2-46a1-bab0-1c02a21a165e',)
>Thread-321::INFO::2014-01-24 19:24:44,305::nfsSD::69::Storage.StorageDomain::(create) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e domainName=export remotePath=10.34.63.199:/cmg01 domClass=3
>Thread-321::DEBUG::2014-01-24 19:24:44,416::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-321::DEBUG::2014-01-24 19:24:44,419::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[]
>Thread-321::WARNING::2014-01-24 19:24:44,420::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is
>Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-321::DEBUG::2014-01-24 19:24:44,420::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd']
>Thread-321::DEBUG::2014-01-24 19:24:44,435::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-321::DEBUG::2014-01-24 19:24:44,436::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-321::DEBUG::2014-01-24 19:24:44,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-321::DEBUG::2014-01-24 19:24:44,442::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd']
>Thread-321::DEBUG::2014-01-24 19:24:44,444::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-321::DEBUG::2014-01-24 19:24:44,444::clusterlock::65::Storage.Misc.excCmd::(initLock) '/usr/libexec/vdsm/safelease release -f /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/leases 0' (cwd /usr/libexec/vdsm)
>Thread-321::DEBUG::2014-01-24 19:24:44,451::clusterlock::65::Storage.Misc.excCmd::(initLock) SUCCESS: <err> = ''; <rc> = 0
>Thread-321::DEBUG::2014-01-24 19:24:44,451::sd::424::Storage.StorageDomain::(initSPMlease) lease initialized successfully
>Thread-321::DEBUG::2014-01-24 19:24:44,452::hsm::2592::Storage.HSM::(createStorageDomain) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-321::INFO::2014-01-24 19:24:44,453::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None
>Thread-329::DEBUG::2014-01-24 19:24:44,465::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [732a500a]
>Thread-329::INFO::2014-01-24 19:24:44,465::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None)
>Thread-329::INFO::2014-01-24 19:24:44,467::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '144349298688', 'disktotal': '144349954048', 'mdafree': 0}}
>Thread-326::DEBUG::2014-01-24 19:24:44,495::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-326::INFO::2014-01-24 19:24:44,496::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}}}
>Thread-330::DEBUG::2014-01-24 19:24:44,731::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [6d96a476]
>Thread-330::INFO::2014-01-24 19:24:44,731::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None)
>Thread-330::DEBUG::2014-01-24 19:24:44,732::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount -f -l /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None)
>Thread-330::DEBUG::2014-01-24 19:24:44,762::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-330::DEBUG::2014-01-24 19:24:44,763::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:45,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:45,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278903 s, 36.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:45,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:45,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-330::DEBUG::2014-01-24 19:24:46,994::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:47,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:47,668::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270476 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:47,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:47,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-330::DEBUG::2014-01-24 19:24:49,651::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-330::INFO::2014-01-24 19:24:49,652::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]}
>Dummy-233::DEBUG::2014-01-24 19:24:49,677::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:49,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273179 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:49,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:49,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-332::DEBUG::2014-01-24 19:24:49,989::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [3a071170]
>Thread-332::INFO::2014-01-24 19:24:49,990::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None)
>Thread-332::DEBUG::2014-01-24 19:24:49,992::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=3 10.34.63.199:/cmg01 /rhev/data-center/mnt/10.34.63.199:_cmg01' (cwd None)
>Thread-332::DEBUG::2014-01-24 19:24:50,024::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-332::DEBUG::2014-01-24 19:24:50,025::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('464da998-ebd2-46a1-bab0-1c02a21a165e',)
>Thread-332::DEBUG::2014-01-24 19:24:50,026::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-332::INFO::2014-01-24 19:24:50,026::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]}
>Thread-333::DEBUG::2014-01-24 19:24:50,037::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [14e41552]
>Thread-333::INFO::2014-01-24 19:24:50,037::logUtils::44::dispatcher::(wrapper) Run and protect: attachStorageDomain(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-333::INFO::2014-01-24 19:24:50,038::sp::928::Storage.StoragePool::(attachSD) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638
>Thread-333::DEBUG::2014-01-24 19:24:50,040::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:51,088::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:51,739::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:51,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:51,772::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:51,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487903 s, 21.0 MB/s\n'; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:24:52,642::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:24:52,643::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-333::DEBUG::2014-01-24 19:24:52,643::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-335::INFO::2014-01-24 19:24:53,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-335::INFO::2014-01-24 19:24:53,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00056434', 'lastCheck': '12.4', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:24:53,785::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:53,790::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:53,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:53,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277657 s, 36.9 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:54,242::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:24:54,246::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:24:54,252::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615814 s, 6.7 MB/s\n'; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:24:55,374::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:55,793::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:55,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:24:55,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:24:55,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272337 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:57,802::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:57,808::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:24:57,935::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:24:57,939::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-333::DEBUG::2014-01-24 19:24:57,941::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-333::DEBUG::2014-01-24 19:24:57,945::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd']
>Dummy-233::DEBUG::2014-01-24 19:24:57,946::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-333::DEBUG::2014-01-24 19:24:57,952::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-333::INFO::2014-01-24 19:24:57,953::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered
>Thread-333::INFO::2014-01-24 19:24:57,953::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered
>Thread-333::DEBUG::2014-01-24 19:24:57,954::clusterlock::110::Storage.Misc.excCmd::(acquire) '/usr/bin/sudo -n /usr/bin/setsid /usr/bin/ionice -c 1 -n 0 /bin/su vdsm -s /bin/sh -c "/usr/libexec/vdsm/spmprotect.sh start 464da998-ebd2-46a1-bab0-1c02a21a165e 1 5 /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/leases 60000 10000 3"' (cwd /usr/libexec/vdsm)
>Dummy-233::DEBUG::2014-01-24 19:24:58,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278754 s, 36.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:24:59,812::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:24:59,818::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:00,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:00,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269393 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:01,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:01,829::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:02,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:02,126::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273165 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:03,832::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:03,838::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:04,135::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:04,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275761 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:25:04,258::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:05,841::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:05,846::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:06,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:06,250::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275222 s, 37.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:25:06,600::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:25:06,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:06,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000460607 s, 8.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:07,849::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:07,855::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:08,259::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:08,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271382 s, 37.7 MB/s\n'; <rc> = 0
>Thread-342::INFO::2014-01-24 19:25:08,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-342::INFO::2014-01-24 19:25:08,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000460607', 'lastCheck': '2.1', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:25:09,862::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:09,867::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:10,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:10,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275293 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:11,870::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:11,875::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:12,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:12,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269667 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:13,878::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:13,883::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:14,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:14,498::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274525 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:15,886::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:15,891::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:16,507::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:16,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275829 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:25:16,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:16,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061967 s, 6.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:17,894::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:17,900::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:17,982::clusterlock::110::Storage.Misc.excCmd::(acquire) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=71e41825fb5b8775e2d4dc4458bb7ee25f0b48dd']
>Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-333::DEBUG::2014-01-24 19:25:17,988::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83a3e5dc11dd4cce15e37a7d8e35b7b6f70f1c39']
>Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-333::DEBUG::2014-01-24 19:25:17,993::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Attached', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395']
>Thread-333::DEBUG::2014-01-24 19:25:17,994::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:18,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:18,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270886 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:19,903::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:19,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:20,160::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:20,161::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active --deltag MDT__SHA_CKSUM=692df01593caafb25d84c10d1bf2b141b7572979 --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Attached --addtag MDT__SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-333::DEBUG::2014-01-24 19:25:20,359::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:20,360::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-333::INFO::2014-01-24 19:25:20,360::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-333::DEBUG::2014-01-24 19:25:20,360::clusterlock::125::Storage.Misc.excCmd::(release) '/usr/libexec/vdsm/spmstop.sh 464da998-ebd2-46a1-bab0-1c02a21a165e' (cwd /usr/libexec/vdsm)
>Dummy-233::DEBUG::2014-01-24 19:25:20,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:20,685::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277698 s, 36.9 MB/s\n'; <rc> = 0
>Thread-333::DEBUG::2014-01-24 19:25:21,379::clusterlock::125::Storage.Misc.excCmd::(release) SUCCESS: <err> = ''; <rc> = 0
>Thread-333::INFO::2014-01-24 19:25:21,380::logUtils::47::dispatcher::(wrapper) Run and protect: attachStorageDomain, Return response: None
>Thread-348::DEBUG::2014-01-24 19:25:21,390::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [22979cf5]
>Thread-348::INFO::2014-01-24 19:25:21,391::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', size='10737418240', volFormat=5, preallocate=1, diskType=2, volUUID='e695cd65-e815-4ace-956d-7e24736a8a43', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000')
>Thread-348::INFO::2014-01-24 19:25:21,436::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:21,500::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-349::DEBUG::2014-01-24 19:25:21,508::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-349::INFO::2014-01-24 19:25:21,508::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-349::INFO::2014-01-24 19:25:21,509::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-350::DEBUG::2014-01-24 19:25:21,517::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-350::INFO::2014-01-24 19:25:21,517::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-350::DEBUG::2014-01-24 19:25:21,518::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-351::DEBUG::2014-01-24 19:25:21,567::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [2ef684a]
>Thread-351::INFO::2014-01-24 19:25:21,568::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.63.199:/cmg01', 'iqn': '', 'portal': '', 'user': '', 'password': '******', 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7', 'port': ''}], options=None)
>Thread-351::DEBUG::2014-01-24 19:25:21,571::hsm::2273::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/10.34.63.199:_cmg01
>Thread-351::DEBUG::2014-01-24 19:25:21,571::hsm::2297::Storage.HSM::(__prefetchDomains) Found SD uuids: ('464da998-ebd2-46a1-bab0-1c02a21a165e',)
>Thread-351::DEBUG::2014-01-24 19:25:21,572::hsm::2353::Storage.HSM::(connectStorageServer) knownSDs: {a250db32-9b39-4533-8bc6-926d4ae17535: storage.blockSD.findDomain, c90b62f4-61ad-450d-9ef5-268a6ccb0fc0: storage.blockSD.findDomain, a0e1b6de-824a-4543-8c86-adc34e634cee: storage.nfsSD.findDomain, 464da998-ebd2-46a1-bab0-1c02a21a165e: storage.nfsSD.findDomain, 6116a097-264f-40f2-9c37-b0a1d79b1dd2: storage.blockSD.findDomain}
>Thread-351::INFO::2014-01-24 19:25:21,572::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '6f3bd24d-333c-4c0f-8d9d-57f611221fc7'}]}
>Thread-12::DEBUG::2014-01-24 19:25:21,911::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:21,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:22,694::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:22,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245944 s, 41.6 MB/s\n'; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,837::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,841::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,841::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 529697b6-0f60-43c8-8fe1-ae01cfc536eb does not exist in domain a250db32-9b39-4533-8bc6-926d4ae17535
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:23,841::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb for image's volumes
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:23,879::volume::443::Storage.Volume::(create) Creating volume e695cd65-e815-4ace-956d-7e24736a8a43
>Thread-12::DEBUG::2014-01-24 19:25:23,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-350::DEBUG::2014-01-24 19:25:23,927::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-350::INFO::2014-01-24 19:25:23,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Attached', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '86704652288', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Attached', 'isoprefix': '', 'alerts': []}}}
>Thread-12::DEBUG::2014-01-24 19:25:23,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:23,937::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 10240m --addtag OVIRT_VOL_INITIALIZING --name e695cd65-e815-4ace-956d-7e24736a8a43 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-352::DEBUG::2014-01-24 19:25:24,004::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4cb92eb6]
>Thread-352::INFO::2014-01-24 19:25:24,004::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-352::INFO::2014-01-24 19:25:24,005::sp::1060::Storage.StoragePool::(activateSD) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638
>Thread-352::DEBUG::2014-01-24 19:25:24,006::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-352::DEBUG::2014-01-24 19:25:24,006::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None)
>Thread-353::INFO::2014-01-24 19:25:24,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-353::INFO::2014-01-24 19:25:24,034::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061967', 'lastCheck': '7.4', 'valid': True}}
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:24,076::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::WARNING::2014-01-24 19:25:24,077::utils::128::root::(rmFile) File: /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 already removed
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::INFO::2014-01-24 19:25:24,077::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 with size = 20971520 sectors
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:24,078::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:24,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:24,806::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027044 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:25,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:25,959::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-352::DEBUG::2014-01-24 19:25:26,232::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None)
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,383::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::WARNING::2014-01-24 19:25:26,388::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG a250db32-9b39-4533-8bc6-926d4ae17535
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:26,388::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_529697b6-0f60-43c8-8fe1-ae01cfc536eb a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:26,626::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:26,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:26,869::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281671 s, 36.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:27,962::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:27,968::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:28,643::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Thread-352::DEBUG::2014-01-24 19:25:28,851::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:28,879::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:28,932::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273364 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:29,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:29,976::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:25:30,738::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:30,749::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:30,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:30,776::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000520921 s, 7.9 MB/s\n'; <rc> = 0
>Thread-352::DEBUG::2014-01-24 19:25:30,781::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-352::DEBUG::2014-01-24 19:25:30,783::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:25:30,785::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-352::DEBUG::2014-01-24 19:25:30,790::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=83a3e5dc11dd4cce15e37a7d8e35b7b6f70f1c39']
>Thread-352::DEBUG::2014-01-24 19:25:30,791::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-352::INFO::2014-01-24 19:25:30,792::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered
>Thread-352::INFO::2014-01-24 19:25:30,792::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered
>Thread-352::INFO::2014-01-24 19:25:30,792::sp::1149::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e to /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-352::DEBUG::2014-01-24 19:25:30,793::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction
>Thread-352::DEBUG::2014-01-24 19:25:30,794::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-352::DEBUG::2014-01-24 19:25:30,794::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc']
>Thread-352::DEBUG::2014-01-24 19:25:30,798::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>Thread-352::DEBUG::2014-01-24 19:25:30,800::sd::620::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/master/vms
>Thread-352::DEBUG::2014-01-24 19:25:30,801::sd::623::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/master/tasks
>Thread-352::DEBUG::2014-01-24 19:25:30,802::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction
>Thread-352::DEBUG::2014-01-24 19:25:30,802::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes
>Thread-352::DEBUG::2014-01-24 19:25:30,803::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=iscsi_0', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'ROLE=Master', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6']
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:30,880::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:30,941::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:30,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277691 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:31,979::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:31,984::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:33,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:33,013::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:33,018::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-352::DEBUG::2014-01-24 19:25:33,025::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:33,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391021 s, 26.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:33,986::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:33,992::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:35,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:35,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248467 s, 41.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:35,995::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:36,000::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:37,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:37,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271076 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:38,003::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:38,008::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:39,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-360::INFO::2014-01-24 19:25:39,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-360::INFO::2014-01-24 19:25:39,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00061967', 'lastCheck': '22.6', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:25:39,287::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502905 s, 20.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:40,012::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:40,019::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:41,303::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:41,353::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245016 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:42,022::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:42,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,137::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,141::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-352::DEBUG::2014-01-24 19:25:42,229::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-352::DEBUG::2014-01-24 19:25:42,231::lvm::295::Storage.Misc.excCmd::(cmd) u'/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --deltag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Attached --deltag MDT__SHA_CKSUM=62b3113fe11101d1ec0b3cc5391cd4deec486395 --addtag MDT_POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active&44&464da998-ebd2-46a1-bab0-1c02a21a165e:Active --addtag MDT__SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6 a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-352::DEBUG::2014-01-24 19:25:42,404::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-352::DEBUG::2014-01-24 19:25:42,405::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction
>3250cadc-e2ca-4426-b4c4-3dd3f40b23f3::DEBUG::2014-01-24 19:25:42,406::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=e695cd65-e815-4ace-956d-7e24736a8a43 sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535, metaId=('a250db32-9b39-4533-8bc6-926d4ae17535', 4)
>Thread-352::INFO::2014-01-24 19:25:42,407::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-352::DEBUG::2014-01-24 19:25:42,408::sp::1506::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `3ea3dad7-383a-417b-b9b7-63ce4660f638` started monitoring domain `464da998-ebd2-46a1-bab0-1c02a21a165e`
>Thread-363::DEBUG::2014-01-24 19:25:42,408::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-352::INFO::2014-01-24 19:25:42,411::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None
>Thread-364::DEBUG::2014-01-24 19:25:42,439::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-363::DEBUG::2014-01-24 19:25:42,440::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-364::INFO::2014-01-24 19:25:42,445::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-364::INFO::2014-01-24 19:25:42,446::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-363::DEBUG::2014-01-24 19:25:42,449::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.0002816 s, 1.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:25:42,450::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 464da998-ebd2-46a1-bab0-1c02a21a165e changed its status to Valid
>Thread-365::DEBUG::2014-01-24 19:25:42,450::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-365::DEBUG::2014-01-24 19:25:42,450::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-365::DEBUG::2014-01-24 19:25:42,451::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain`
>Thread-365::DEBUG::2014-01-24 19:25:42,451::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-366::INFO::2014-01-24 19:25:42,456::clientIF::126::vds::(contEIOVms) vmContainerLock acquired
>Thread-368::DEBUG::2014-01-24 19:25:42,460::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [4cb92eb6]
>Thread-368::INFO::2014-01-24 19:25:42,461::logUtils::44::dispatcher::(wrapper) Run and protect: refreshStoragePool(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', msdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', masterVersion=1, options=None)
>Thread-368::INFO::2014-01-24 19:25:42,465::hsm::865::Storage.HSM::(refreshStoragePool) Ignoring the refreshStoragePool request (the host is the SPM)
>Thread-368::INFO::2014-01-24 19:25:42,466::logUtils::47::dispatcher::(wrapper) Run and protect: refreshStoragePool, Return response: None
>Thread-369::DEBUG::2014-01-24 19:25:42,471::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-369::INFO::2014-01-24 19:25:42,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-369::DEBUG::2014-01-24 19:25:42,475::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:43,362::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:43,415::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272945 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:44,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:44,039::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:45,424::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:45,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274137 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:46,042::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:46,047::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-369::DEBUG::2014-01-24 19:25:46,603::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-369::INFO::2014-01-24 19:25:46,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '75967234048', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-371::DEBUG::2014-01-24 19:25:46,681::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-371::INFO::2014-01-24 19:25:46,681::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-371::INFO::2014-01-24 19:25:46,681::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'3250cadc-e2ca-4426-b4c4-3dd3f40b23f3': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '3250cadc-e2ca-4426-b4c4-3dd3f40b23f3'}}}
>Thread-372::DEBUG::2014-01-24 19:25:46,794::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [22979cf5]
>Thread-372::INFO::2014-01-24 19:25:46,794::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', volUUID='e695cd65-e815-4ace-956d-7e24736a8a43', options=None)
>Thread-372::INFO::2014-01-24 19:25:46,795::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb volUUID = e695cd65-e815-4ace-956d-7e24736a8a43 
>Thread-372::DEBUG::2014-01-24 19:25:46,797::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-372::DEBUG::2014-01-24 19:25:46,803::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000553637 s, 925 kB/s\n'; <rc> = 0
>Thread-372::DEBUG::2014-01-24 19:25:46,803::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000553637 s, 925 kB/s'], size: 512
>Thread-372::DEBUG::2014-01-24 19:25:46,805::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-372::DEBUG::2014-01-24 19:25:46,811::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000619979 s, 826 kB/s\n'; <rc> = 0
>Thread-372::DEBUG::2014-01-24 19:25:46,811::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000619979 s, 826 kB/s'], size: 512
>Thread-372::INFO::2014-01-24 19:25:46,811::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '529697b6-0f60-43c8-8fe1-ae01cfc536eb', 'ctime': '1390587942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587942', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e695cd65-e815-4ace-956d-7e24736a8a43', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-372::INFO::2014-01-24 19:25:46,811::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': '529697b6-0f60-43c8-8fe1-ae01cfc536eb', 'ctime': '1390587942', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587942', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e695cd65-e815-4ace-956d-7e24736a8a43', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-373::DEBUG::2014-01-24 19:25:46,942::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-373::INFO::2014-01-24 19:25:46,942::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='3250cadc-e2ca-4426-b4c4-3dd3f40b23f3', spUUID=None, options=None)
>Thread-373::INFO::2014-01-24 19:25:46,943::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Dummy-233::DEBUG::2014-01-24 19:25:47,486::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:47,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277813 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:48,050::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:48,056::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:49,549::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:49,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272038 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:50,059::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:50,064::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:51,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:51,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274774 s, 37.3 MB/s\n'; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,017::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18bad2f6]
>Thread-376::INFO::2014-01-24 19:25:52,017::logUtils::44::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmUUID='', srcImgUUID='529697b6-0f60-43c8-8fe1-ae01cfc536eb', srcVolUUID='e695cd65-e815-4ace-956d-7e24736a8a43', dstImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', dstVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', description='Active VM', dstSdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', volType=6, volFormat=5, preallocate=1, postZero='false', force='false')
>Thread-376::DEBUG::2014-01-24 19:25:52,018::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:52,067::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:52,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,114::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,117::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-376::INFO::2014-01-24 19:25:52,117::image::285::Storage.Image::(isLegal) image 529697b6-0f60-43c8-8fe1-ae01cfc536eb in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist ['e695cd65-e815-4ace-956d-7e24736a8a43']
>Thread-376::DEBUG::2014-01-24 19:25:52,120::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-376::DEBUG::2014-01-24 19:25:52,125::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000447091 s, 1.1 MB/s\n'; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,126::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000447091 s, 1.1 MB/s'], size: 512
>Thread-376::DEBUG::2014-01-24 19:25:52,128::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-376::DEBUG::2014-01-24 19:25:52,133::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000482628 s, 1.1 MB/s\n'; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,133::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000482628 s, 1.1 MB/s'], size: 512
>Thread-376::DEBUG::2014-01-24 19:25:52,134::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-376::DEBUG::2014-01-24 19:25:52,228::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,233::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-376::DEBUG::2014-01-24 19:25:52,235::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-376::DEBUG::2014-01-24 19:25:52,241::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000550177 s, 931 kB/s\n'; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,241::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000550177 s, 931 kB/s'], size: 512
>Thread-376::DEBUG::2014-01-24 19:25:52,243::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-376::DEBUG::2014-01-24 19:25:52,249::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00053744 s, 953 kB/s\n'; <rc> = 0
>Thread-376::DEBUG::2014-01-24 19:25:52,249::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00053744 s, 953 kB/s'], size: 512
>Thread-376::INFO::2014-01-24 19:25:52,249::image::215::Storage.Image::(getChain) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb chain=[<storage.blockVolume.BlockVolume object at 0x7f88a03a9a90>] 
>Thread-376::INFO::2014-01-24 19:25:52,282::logUtils::47::dispatcher::(wrapper) Run and protect: copyImage, Return response: None
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,353::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:52,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:25:52,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000353308 s, 11.6 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,446::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,450::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,466::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,475::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000417735 s, 1.2 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,476::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000417735 s, 1.2 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,492::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:25:52,503::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,508::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000446263 s, 1.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,510::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000446263 s, 1.1 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,511::image::215::Storage.Image::(getChain) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb chain=[<storage.blockVolume.BlockVolume object at 0x7f88a0325c90>] 
>Thread-363::DEBUG::2014-01-24 19:25:52,517::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000272964 s, 1.3 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,521::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,615::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,618::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,618::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image df30ebf7-0d71-40b0-a33e-07170bdead7d does not exist in domain a250db32-9b39-4533-8bc6-926d4ae17535
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,619::image::645::Storage.Image::(copyCollapsed) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 vmUUID= srcImgUUID=529697b6-0f60-43c8-8fe1-ae01cfc536eb srcVolUUID=e695cd65-e815-4ace-956d-7e24736a8a43 dstImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d dstVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstSdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 volType=6 volFormat=RAW preallocate=PREALLOCATED force=False postZero=False
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,621::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,627::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000560452 s, 914 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,627::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000560452 s, 914 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,629::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,635::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526872 s, 972 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,635::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526872 s, 972 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,637::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,642::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0005531 s, 926 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,643::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0005531 s, 926 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,645::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,650::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000505854 s, 1.0 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,650::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000505854 s, 1.0 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,653::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,659::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000506787 s, 1.0 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,659::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000506787 s, 1.0 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,663::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,669::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000604137 s, 847 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,669::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000604137 s, 847 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,669::image::695::Storage.Image::(copyCollapsed) copy source a250db32-9b39-4533-8bc6-926d4ae17535:529697b6-0f60-43c8-8fe1-ae01cfc536eb:e695cd65-e815-4ace-956d-7e24736a8a43 vol size 20971520 destination a250db32-9b39-4533-8bc6-926d4ae17535:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b apparentsize 20971520
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,670::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,764::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,768::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,769::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist []
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,769::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d for image's volumes
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:52,811::volume::443::Storage.Volume::(create) Creating volume 228f2939-3615-4733-ae3c-fc37390a2d0b
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:52,868::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --contiguous n --size 10m --addtag OVIRT_VOL_INITIALIZING --name 228f2939-3615-4733-ae3c-fc37390a2d0b a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:53,005::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::WARNING::2014-01-24 19:25:53,006::utils::128::root::(rmFile) File: /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b already removed
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:25:53,007::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b with size = 20480 sectors
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:53,008::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:53,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:53,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261552 s, 39.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:54,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:54,081::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-377::INFO::2014-01-24 19:25:54,470::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-377::INFO::2014-01-24 19:25:54,470::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000353308', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000272964', 'lastCheck': '1.9', 'valid': True}}
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,255::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,260::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::WARNING::2014-01-24 19:25:55,260::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,261::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 5 in VG a250db32-9b39-4533-8bc6-926d4ae17535
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:55,261::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_df30ebf7-0d71-40b0-a33e-07170bdead7d --addtag MD_5 a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:55,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:55,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243256 s, 42.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:56,085::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:56,090::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-379::DEBUG::2014-01-24 19:25:56,683::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-379::INFO::2014-01-24 19:25:56,683::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-379::INFO::2014-01-24 19:25:56,683::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-380::DEBUG::2014-01-24 19:25:56,691::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-380::INFO::2014-01-24 19:25:56,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-380::DEBUG::2014-01-24 19:25:56,692::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:57,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:57,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272219 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:25:58,093::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:25:58,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:25:58,727::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:25:59,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:25:59,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276633 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:00,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:00,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-380::DEBUG::2014-01-24 19:26:00,970::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-380::INFO::2014-01-24 19:26:00,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '75967234048', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:00,978::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>Thread-383::DEBUG::2014-01-24 19:26:01,029::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-383::INFO::2014-01-24 19:26:01,029::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-383::INFO::2014-01-24 19:26:01,029::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,080::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,081::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,175::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,180::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:01,180::volume::485::Storage.Volume::(create) The requested size for volume 228f2939-3615-4733-ae3c-fc37390a2d0b doesn't match the granularity on domain a250db32-9b39-4533-8bc6-926d4ae17535, updating the volume size from 20480 to 262144
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,276::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=228f2939-3615-4733-ae3c-fc37390a2d0b sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535, metaId=('a250db32-9b39-4533-8bc6-926d4ae17535', 5)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:01,324::blockVolume::268::Storage.Volume::(extend) Request to extend LV 228f2939-3615-4733-ae3c-fc37390a2d0b of image df30ebf7-0d71-40b0-a33e-07170bdead7d in VG a250db32-9b39-4533-8bc6-926d4ae17535 with size = 20971520
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,324::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --size 10240m a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,428::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  WARNING: This metadata update is NOT backed up\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:01,429::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:01,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:01,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245516 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:02,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:02,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:02,446::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:02,528::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:02,534::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000319537 s, 1.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,827::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,831::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,833::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,839::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000483937 s, 1.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,840::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000483937 s, 1.1 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:03,842::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,844::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,850::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000501642 s, 1.0 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,850::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000501642 s, 1.0 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:03,851::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:03,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:04,032::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273721 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:04,119::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:04,125::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:04,660::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:04,663::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:04,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000397423 s, 10.3 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:06,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:06,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242733 s, 42.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:06,128::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:06,133::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,147::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,150::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,244::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,248::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,251::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,256::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000454155 s, 1.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,257::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000454155 s, 1.1 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:26:06,257::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,259::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,264::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000565785 s, 905 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,265::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000565785 s, 905 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,267::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,272::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000518569 s, 987 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,272::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000518569 s, 987 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,273::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,462::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,463::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,557::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,561::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,564::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,569::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000471775 s, 1.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,570::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000471775 s, 1.1 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,572::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,577::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000572383 s, 895 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,577::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000572383 s, 895 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,582::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000332106 s, 1.5 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000332106 s, 1.5 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,588::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 (raw) to /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) START
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:26:06,591::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 of=/rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10240 oflag=direct' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:08,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:08,136::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:08,153::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:08,188::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504783 s, 20.3 MB/s\n'; <rc> = 0
>Thread-386::INFO::2014-01-24 19:26:09,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-386::INFO::2014-01-24 19:26:09,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397423', 'lastCheck': '5.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319537', 'lastCheck': '7.2', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:26:10,167::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:10,173::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:10,197::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:10,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293175 s, 34.9 MB/s\n'; <rc> = 0
>Thread-388::DEBUG::2014-01-24 19:26:11,032::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-388::INFO::2014-01-24 19:26:11,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-388::INFO::2014-01-24 19:26:11,032::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-389::DEBUG::2014-01-24 19:26:11,076::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-389::INFO::2014-01-24 19:26:11,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-389::INFO::2014-01-24 19:26:11,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': 'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': 'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': 'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-390::DEBUG::2014-01-24 19:26:11,140::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-390::INFO::2014-01-24 19:26:11,140::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-390::INFO::2014-01-24 19:26:11,140::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:26:12,176::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:12,181::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:12,262::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:12,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273072 s, 37.5 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:26:12,541::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:12,551::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00131444 s, 260 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:14,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:14,190::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:14,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:14,383::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303778 s, 33.7 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:14,673::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-120::DEBUG::2014-01-24 19:26:14,673::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:26:14,676::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:14,688::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00687008 s, 298 kB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:14,688::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00687008 s, 298 kB/s'], size: 2048
>Thread-120::DEBUG::2014-01-24 19:26:14,688::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-120::DEBUG::2014-01-24 19:26:14,688::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:26:14,689::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:16,193::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:16,199::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:16,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:16,462::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384343 s, 26.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:17,222::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:17,223::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6']
>Thread-120::INFO::2014-01-24 19:26:17,223::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-120::INFO::2014-01-24 19:26:17,223::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-120::INFO::2014-01-24 19:26:17,224::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-120::DEBUG::2014-01-24 19:26:17,224::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:17,393::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:17,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:17,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00452359 s, 905 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:18,202::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:18,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:18,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:18,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338103 s, 30.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:20,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:20,216::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:20,543::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:20,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337204 s, 30.4 MB/s\n'; <rc> = 0
>Thread-394::DEBUG::2014-01-24 19:26:21,145::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-394::INFO::2014-01-24 19:26:21,145::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-394::INFO::2014-01-24 19:26:21,146::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-395::DEBUG::2014-01-24 19:26:21,154::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-395::INFO::2014-01-24 19:26:21,155::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-395::INFO::2014-01-24 19:26:21,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-396::DEBUG::2014-01-24 19:26:21,196::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-396::INFO::2014-01-24 19:26:21,196::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-396::INFO::2014-01-24 19:26:21,196::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:26:22,219::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:22,225::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:26:22,559::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:22,568::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00188342 s, 182 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:22,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:22,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338749 s, 30.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:24,228::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:24,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:24,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:24,740::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286743 s, 35.7 MB/s\n'; <rc> = 0
>Thread-398::INFO::2014-01-24 19:26:24,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-398::INFO::2014-01-24 19:26:24,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00452359', 'lastCheck': '7.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00188342', 'lastCheck': '2.3', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:26:26,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:26,242::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:26,750::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:26,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269756 s, 38.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:27,412::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:27,422::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0037507 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:28,246::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:28,252::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:28,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:28,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318698 s, 32.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:30,255::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:30,260::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:30,882::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:30,934::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266304 s, 38.5 MB/s\n'; <rc> = 0
>Thread-402::DEBUG::2014-01-24 19:26:31,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-402::INFO::2014-01-24 19:26:31,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-402::INFO::2014-01-24 19:26:31,194::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-403::DEBUG::2014-01-24 19:26:31,216::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-403::INFO::2014-01-24 19:26:31,216::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-403::INFO::2014-01-24 19:26:31,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:26:32,263::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:32,268::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:26:32,575::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:32,581::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00032592 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:32,944::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:32,996::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265901 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:34,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:34,277::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-405::DEBUG::2014-01-24 19:26:34,985::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-405::INFO::2014-01-24 19:26:34,986::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-405::INFO::2014-01-24 19:26:34,986::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:26:35,005::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:35,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251908 s, 40.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:36,280::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:36,286::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:37,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:37,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315473 s, 32.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:37,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:37,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0036599 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:38,289::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:38,294::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:39,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:39,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308067 s, 33.2 MB/s\n'; <rc> = 0
>Thread-407::INFO::2014-01-24 19:26:40,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-407::INFO::2014-01-24 19:26:40,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0036599', 'lastCheck': '2.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00032592', 'lastCheck': '7.6', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:26:40,297::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:40,302::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:41,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:41,263::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282556 s, 36.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:42,306::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:42,311::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:26:42,589::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:42,596::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00067999 s, 503 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:43,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:43,336::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365287 s, 28.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:44,314::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:44,319::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-410::DEBUG::2014-01-24 19:26:44,984::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-410::INFO::2014-01-24 19:26:44,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-410::INFO::2014-01-24 19:26:44,985::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-411::DEBUG::2014-01-24 19:26:44,993::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-411::INFO::2014-01-24 19:26:44,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-411::INFO::2014-01-24 19:26:44,994::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:26:45,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:45,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264005 s, 38.8 MB/s\n'; <rc> = 0
>Thread-412::DEBUG::2014-01-24 19:26:45,784::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-412::INFO::2014-01-24 19:26:45,785::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-412::INFO::2014-01-24 19:26:45,785::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:26:46,323::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:46,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:47,406::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:47,458::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:47,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00351482 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:47,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256189 s, 40.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:48,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:48,339::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:49,519::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:49,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336612 s, 30.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:50,342::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:50,348::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:51,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:51,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266521 s, 38.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:52,351::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:52,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:26:52,604::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:26:52,613::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00159454 s, 214 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:53,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:53,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297623 s, 34.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:54,360::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:54,365::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-416::INFO::2014-01-24 19:26:55,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-416::INFO::2014-01-24 19:26:55,431::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00351482', 'lastCheck': '7.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00159454', 'lastCheck': '2.8', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:26:55,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:55,769::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257701 s, 39.7 MB/s\n'; <rc> = 0
>Thread-418::DEBUG::2014-01-24 19:26:55,796::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-418::INFO::2014-01-24 19:26:55,797::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-418::INFO::2014-01-24 19:26:55,797::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-419::DEBUG::2014-01-24 19:26:55,808::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-419::INFO::2014-01-24 19:26:55,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-419::INFO::2014-01-24 19:26:55,809::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:26:56,368::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:56,373::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:26:57,498::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:26:57,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0059804 s, 685 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:26:57,778::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:57,831::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265587 s, 38.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:26:58,376::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:26:58,382::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-420::DEBUG::2014-01-24 19:26:58,778::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-420::INFO::2014-01-24 19:26:58,779::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-420::INFO::2014-01-24 19:26:58,779::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:26:59,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:26:59,893::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255146 s, 40.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:00,385::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:00,391::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:01,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:01,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0238531 s, 42.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:02,394::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:02,399::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:02,622::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:02,628::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000277729 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:03,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:04,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027973 s, 36.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:04,403::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:04,408::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:06,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:06,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027783 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:06,411::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:06,417::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:07,515::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:07,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0046843 s, 874 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:08,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:08,148::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312819 s, 32.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:08,420::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:08,426::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-424::DEBUG::2014-01-24 19:27:08,708::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-424::INFO::2014-01-24 19:27:08,708::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-424::INFO::2014-01-24 19:27:08,708::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-425::DEBUG::2014-01-24 19:27:08,729::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-425::INFO::2014-01-24 19:27:08,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-425::INFO::2014-01-24 19:27:08,733::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-426::DEBUG::2014-01-24 19:27:08,898::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-426::INFO::2014-01-24 19:27:08,899::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-426::INFO::2014-01-24 19:27:08,899::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:27:10,158::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:10,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317985 s, 32.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:10,429::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:10,434::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:12,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:12,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.031173 s, 32.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:12,437::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:12,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:12,636::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:12,642::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033051 s, 1.0 MB/s\n'; <rc> = 0
>Thread-428::INFO::2014-01-24 19:27:13,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-428::INFO::2014-01-24 19:27:13,732::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0046843', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033051', 'lastCheck': '1.1', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:27:14,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:14,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287368 s, 35.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:14,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:14,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:16,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:16,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268718 s, 38.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:16,454::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:16,460::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:17,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:17,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000545342 s, 7.5 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:18,420::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:18,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:18,474::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:18,493::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262986 s, 38.9 MB/s\n'; <rc> = 0
>Thread-431::DEBUG::2014-01-24 19:27:18,902::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-431::INFO::2014-01-24 19:27:18,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-431::INFO::2014-01-24 19:27:18,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-432::DEBUG::2014-01-24 19:27:18,914::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-432::INFO::2014-01-24 19:27:18,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-432::INFO::2014-01-24 19:27:18,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-433::DEBUG::2014-01-24 19:27:19,040::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-433::INFO::2014-01-24 19:27:19,040::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-433::INFO::2014-01-24 19:27:19,040::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:27:20,485::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:20,490::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:20,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:20,557::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287121 s, 35.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:22,493::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:22,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:22,566::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:22,626::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325701 s, 31.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:22,650::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:22,656::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000297412 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:24,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:24,508::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:24,635::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:24,690::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277863 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:26,511::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:26,516::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:26,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:26,757::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304439 s, 33.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:27,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:27,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000360993 s, 11.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:28,519::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:28,525::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:28,767::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:28,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286403 s, 35.8 MB/s\n'; <rc> = 0
>Thread-437::DEBUG::2014-01-24 19:27:29,022::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-437::INFO::2014-01-24 19:27:29,022::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-437::INFO::2014-01-24 19:27:29,022::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-438::DEBUG::2014-01-24 19:27:29,028::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-438::INFO::2014-01-24 19:27:29,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-438::INFO::2014-01-24 19:27:29,030::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-439::DEBUG::2014-01-24 19:27:29,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-439::INFO::2014-01-24 19:27:29,134::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-439::INFO::2014-01-24 19:27:29,134::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:27:30,528::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:30,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-440::INFO::2014-01-24 19:27:30,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-440::INFO::2014-01-24 19:27:30,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000360993', 'lastCheck': '3.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297412', 'lastCheck': '7.9', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:27:30,832::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:30,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029723 s, 34.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:32,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:32,542::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:32,664::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:32,670::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000321766 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:32,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:32,959::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344382 s, 29.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:34,545::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:34,551::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:34,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:35,024::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027562 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:36,554::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:36,559::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:37,033::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:37,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264925 s, 38.7 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:37,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:37,560::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000557722 s, 7.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:38,562::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:38,567::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:39,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-444::DEBUG::2014-01-24 19:27:39,135::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-444::INFO::2014-01-24 19:27:39,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-444::INFO::2014-01-24 19:27:39,138::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-445::DEBUG::2014-01-24 19:27:39,148::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-445::INFO::2014-01-24 19:27:39,150::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-445::INFO::2014-01-24 19:27:39,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:27:39,170::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026637 s, 38.4 MB/s\n'; <rc> = 0
>Thread-446::DEBUG::2014-01-24 19:27:39,594::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-446::INFO::2014-01-24 19:27:39,594::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-446::INFO::2014-01-24 19:27:39,595::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:27:40,570::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:40,576::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:41,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:41,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0240604 s, 42.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:42,579::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:42,585::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:42,678::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:42,685::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000322848 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:43,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:43,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306672 s, 33.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:44,588::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:44,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:45,307::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:45,361::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267539 s, 38.3 MB/s\n'; <rc> = 0
>Thread-449::INFO::2014-01-24 19:27:45,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-449::INFO::2014-01-24 19:27:45,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000557722', 'lastCheck': '8.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000322848', 'lastCheck': '3.1', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:27:46,596::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:46,602::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:47,370::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:47,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298263 s, 34.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:47,565::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:47,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00654988 s, 625 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:48,605::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:48,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:49,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:49,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309393 s, 33.1 MB/s\n'; <rc> = 0
>Thread-452::DEBUG::2014-01-24 19:27:49,567::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-452::INFO::2014-01-24 19:27:49,568::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-452::INFO::2014-01-24 19:27:49,568::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-453::DEBUG::2014-01-24 19:27:49,576::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-453::INFO::2014-01-24 19:27:49,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-453::INFO::2014-01-24 19:27:49,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-454::DEBUG::2014-01-24 19:27:49,670::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-454::INFO::2014-01-24 19:27:49,670::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-454::INFO::2014-01-24 19:27:49,671::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:27:50,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:50,620::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:51,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:51,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267466 s, 38.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:52,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:52,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:27:52,693::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:27:52,699::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000290638 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:53,565::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:53,623::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312298 s, 32.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:54,631::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:54,637::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:55,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:55,689::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282068 s, 36.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:56,640::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:56,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:27:57,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:27:57,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000493083 s, 8.3 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:27:57,698::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:57,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266415 s, 38.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:27:58,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:27:58,653::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-458::DEBUG::2014-01-24 19:27:59,663::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-458::INFO::2014-01-24 19:27:59,663::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-458::INFO::2014-01-24 19:27:59,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-459::DEBUG::2014-01-24 19:27:59,669::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-459::INFO::2014-01-24 19:27:59,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-459::INFO::2014-01-24 19:27:59,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:27:59,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:27:59,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249585 s, 41.0 MB/s\n'; <rc> = 0
>Thread-460::DEBUG::2014-01-24 19:28:00,046::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-460::INFO::2014-01-24 19:28:00,046::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-460::INFO::2014-01-24 19:28:00,046::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:28:00,656::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:00,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-461::INFO::2014-01-24 19:28:01,040::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-461::INFO::2014-01-24 19:28:01,040::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000493083', 'lastCheck': '3.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000290638', 'lastCheck': '8.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:28:01,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:01,875::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269515 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:02,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:02,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:28:02,708::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:02,714::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325964 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:03,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:03,943::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311129 s, 32.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:04,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:04,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:05,952::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:06,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255322 s, 40.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:06,683::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:06,688::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:07,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:07,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00436201 s, 939 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:08,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:08,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305421 s, 33.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:08,691::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:08,697::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-465::DEBUG::2014-01-24 19:28:10,051::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-465::INFO::2014-01-24 19:28:10,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-465::INFO::2014-01-24 19:28:10,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-466::DEBUG::2014-01-24 19:28:10,072::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-466::INFO::2014-01-24 19:28:10,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-466::INFO::2014-01-24 19:28:10,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:28:10,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:10,133::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264221 s, 38.8 MB/s\n'; <rc> = 0
>Thread-467::DEBUG::2014-01-24 19:28:10,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-467::INFO::2014-01-24 19:28:10,140::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-467::INFO::2014-01-24 19:28:10,142::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:28:10,700::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:10,705::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:12,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:12,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296364 s, 34.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:12,708::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:12,713::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:28:12,724::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:12,730::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000334004 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:14,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:14,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269907 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:14,717::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:14,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:16,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-470::INFO::2014-01-24 19:28:16,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-470::INFO::2014-01-24 19:28:16,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00436201', 'lastCheck': '8.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000334004', 'lastCheck': '3.6', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:28:16,350::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0283384 s, 36.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:16,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:16,731::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:17,609::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:17,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000461657 s, 8.9 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:18,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:18,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264546 s, 38.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:18,734::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:18,739::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-472::DEBUG::2014-01-24 19:28:20,138::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-472::INFO::2014-01-24 19:28:20,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-472::INFO::2014-01-24 19:28:20,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-473::DEBUG::2014-01-24 19:28:20,146::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-473::INFO::2014-01-24 19:28:20,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-473::INFO::2014-01-24 19:28:20,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-474::DEBUG::2014-01-24 19:28:20,224::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-474::INFO::2014-01-24 19:28:20,224::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-474::INFO::2014-01-24 19:28:20,224::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:28:20,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:20,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296389 s, 34.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:20,742::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:20,747::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:22,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:22,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317853 s, 32.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:28:22,740::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:22,746::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00036321 s, 942 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:22,750::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:22,755::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:24,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:24,612::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304005 s, 33.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:24,758::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:24,764::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:26,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:26,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0571318 s, 17.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:26,767::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:26,772::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:27,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:27,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00672411 s, 609 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:28,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:28,775::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:28,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:28,798::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341828 s, 30.0 MB/s\n'; <rc> = 0
>Thread-478::DEBUG::2014-01-24 19:28:30,225::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-478::INFO::2014-01-24 19:28:30,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-478::INFO::2014-01-24 19:28:30,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-479::DEBUG::2014-01-24 19:28:30,233::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-479::INFO::2014-01-24 19:28:30,233::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-479::INFO::2014-01-24 19:28:30,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-480::DEBUG::2014-01-24 19:28:30,286::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-480::INFO::2014-01-24 19:28:30,286::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-480::INFO::2014-01-24 19:28:30,286::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:28:30,800::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:30,806::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:30,809::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:30,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264159 s, 38.8 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:28:32,754::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:32,760::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000287162 s, 1.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:32,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:32,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:32,871::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:32,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313977 s, 32.6 MB/s\n'; <rc> = 0
>Thread-482::INFO::2014-01-24 19:28:34,276::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-482::INFO::2014-01-24 19:28:34,276::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00672411', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000287162', 'lastCheck': '1.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:28:34,817::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:34,822::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:34,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:34,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330584 s, 31.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:36,825::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:36,831::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:37,008::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:37,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266211 s, 38.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:37,639::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:37,645::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000515587 s, 7.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:38,833::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:38,839::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:39,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:39,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267905 s, 38.2 MB/s\n'; <rc> = 0
>Thread-484::DEBUG::2014-01-24 19:28:40,295::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-484::INFO::2014-01-24 19:28:40,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-484::INFO::2014-01-24 19:28:40,295::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-485::DEBUG::2014-01-24 19:28:40,301::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-485::INFO::2014-01-24 19:28:40,301::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-485::INFO::2014-01-24 19:28:40,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:28:40,842::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:40,848::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-487::DEBUG::2014-01-24 19:28:40,850::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-487::INFO::2014-01-24 19:28:40,852::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-487::INFO::2014-01-24 19:28:40,854::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:28:41,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:41,191::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332274 s, 30.8 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:28:42,768::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:42,775::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000648579 s, 527 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:42,859::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:42,865::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:43,200::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:43,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275729 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:44,868::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:44,874::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:45,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:45,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274502 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:46,877::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:46,882::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:47,328::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:47,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297954 s, 34.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:47,651::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:47,657::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00030529 s, 13.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:48,885::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:48,891::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:49,395::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:49,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331037 s, 30.9 MB/s\n'; <rc> = 0
>Thread-491::DEBUG::2014-01-24 19:28:50,848::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-491::INFO::2014-01-24 19:28:50,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-491::INFO::2014-01-24 19:28:50,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-492::DEBUG::2014-01-24 19:28:50,857::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-492::INFO::2014-01-24 19:28:50,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-492::INFO::2014-01-24 19:28:50,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:28:50,894::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:50,900::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-493::DEBUG::2014-01-24 19:28:50,922::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-493::INFO::2014-01-24 19:28:50,922::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-493::INFO::2014-01-24 19:28:50,923::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:28:51,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:51,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310442 s, 33.0 MB/s\n'; <rc> = 0
>Thread-494::INFO::2014-01-24 19:28:52,642::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-494::INFO::2014-01-24 19:28:52,643::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00030529', 'lastCheck': '5.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000648579', 'lastCheck': '9.9', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:28:52,784::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:28:52,789::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000356573 s, 959 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:52,903::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:52,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:53,532::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:53,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330243 s, 31.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:54,912::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:54,941::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:55,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:55,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345786 s, 29.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:56,944::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:56,949::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:28:57,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:28:57,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000452659 s, 9.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:57,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:57,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271503 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:28:58,952::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:28:58,957::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:28:59,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:28:59,840::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342944 s, 29.9 MB/s\n'; <rc> = 0
>Thread-498::DEBUG::2014-01-24 19:29:00,929::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-498::INFO::2014-01-24 19:29:00,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-498::INFO::2014-01-24 19:29:00,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-499::DEBUG::2014-01-24 19:29:00,940::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-499::INFO::2014-01-24 19:29:00,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-499::INFO::2014-01-24 19:29:00,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:29:00,960::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:00,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-500::DEBUG::2014-01-24 19:29:00,986::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-500::INFO::2014-01-24 19:29:00,986::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-500::INFO::2014-01-24 19:29:00,987::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:29:01,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:01,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239295 s, 42.8 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:29:02,798::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:02,804::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000293085 s, 1.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:02,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:02,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:03,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:03,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288832 s, 35.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:04,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:04,982::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:05,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:06,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267444 s, 38.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:06,985::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:06,991::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:07,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:07,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00541332 s, 757 kB/s\n'; <rc> = 0
>Thread-503::INFO::2014-01-24 19:29:07,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-503::INFO::2014-01-24 19:29:07,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541332', 'lastCheck': '0.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000293085', 'lastCheck': '5.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:29:08,038::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:08,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312972 s, 32.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:08,994::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:09,000::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:10,105::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:10,162::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303767 s, 33.7 MB/s\n'; <rc> = 0
>Thread-506::DEBUG::2014-01-24 19:29:10,990::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-506::INFO::2014-01-24 19:29:10,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-506::INFO::2014-01-24 19:29:10,990::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-507::DEBUG::2014-01-24 19:29:10,996::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-507::INFO::2014-01-24 19:29:10,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-507::INFO::2014-01-24 19:29:10,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:29:11,002::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:11,008::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-508::DEBUG::2014-01-24 19:29:11,080::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-508::INFO::2014-01-24 19:29:11,081::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-508::INFO::2014-01-24 19:29:11,082::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:29:12,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:12,225::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267277 s, 38.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:29:12,812::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:12,819::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000787443 s, 434 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:13,011::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:13,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:14,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:14,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271062 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:15,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:15,025::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:16,298::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:16,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264179 s, 38.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:17,028::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:17,033::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:17,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:17,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000392826 s, 10.4 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:18,360::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:18,412::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026436 s, 38.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:19,036::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:19,041::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:20,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:20,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300047 s, 34.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:21,044::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:21,049::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-512::DEBUG::2014-01-24 19:29:21,081::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-512::INFO::2014-01-24 19:29:21,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-512::INFO::2014-01-24 19:29:21,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-513::DEBUG::2014-01-24 19:29:21,088::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-513::INFO::2014-01-24 19:29:21,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-513::INFO::2014-01-24 19:29:21,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-514::DEBUG::2014-01-24 19:29:21,351::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-514::INFO::2014-01-24 19:29:21,351::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-514::INFO::2014-01-24 19:29:21,352::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:29:22,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:22,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028248 s, 36.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:29:22,828::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:22,834::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000283997 s, 1.2 MB/s\n'; <rc> = 0
>Thread-515::INFO::2014-01-24 19:29:23,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-12::DEBUG::2014-01-24 19:29:23,053::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-515::INFO::2014-01-24 19:29:23,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392826', 'lastCheck': '5.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000283997', 'lastCheck': '0.2', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:29:23,065::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:24,552::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:24,605::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267973 s, 38.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:25,077::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:25,082::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:26,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:26,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235675 s, 43.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:27,085::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:27,090::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:27,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:27,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000345236 s, 11.9 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:28,673::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:28,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339833 s, 30.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:29,093::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:29,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:30,744::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:30,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343382 s, 29.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:31,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:31,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-519::DEBUG::2014-01-24 19:29:31,353::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-519::INFO::2014-01-24 19:29:31,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-519::INFO::2014-01-24 19:29:31,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-520::DEBUG::2014-01-24 19:29:31,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-520::INFO::2014-01-24 19:29:31,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-520::INFO::2014-01-24 19:29:31,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-521::DEBUG::2014-01-24 19:29:31,555::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-521::INFO::2014-01-24 19:29:31,555::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-521::INFO::2014-01-24 19:29:31,556::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:29:32,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:32,844::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:32,857::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000839073 s, 408 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:32,889::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479202 s, 21.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:33,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:33,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:34,899::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:34,955::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029459 s, 34.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:35,119::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:35,125::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:36,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:37,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280941 s, 36.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:37,128::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:37,133::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:37,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:37,721::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000637228 s, 6.4 MB/s\n'; <rc> = 0
>Thread-524::INFO::2014-01-24 19:29:38,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-524::INFO::2014-01-24 19:29:38,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000637228', 'lastCheck': '0.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000839073', 'lastCheck': '5.4', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:29:39,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:39,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271202 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:39,136::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:39,141::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:41,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:41,144::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:41,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:41,164::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284258 s, 36.0 MB/s\n'; <rc> = 0
>Thread-526::DEBUG::2014-01-24 19:29:41,519::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-526::INFO::2014-01-24 19:29:41,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-526::INFO::2014-01-24 19:29:41,520::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-527::DEBUG::2014-01-24 19:29:41,528::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-527::INFO::2014-01-24 19:29:41,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-527::INFO::2014-01-24 19:29:41,529::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-528::DEBUG::2014-01-24 19:29:41,725::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-528::INFO::2014-01-24 19:29:41,726::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-528::INFO::2014-01-24 19:29:41,726::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-363::DEBUG::2014-01-24 19:29:42,869::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:42,875::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00029243 s, 1.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:43,169::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:43,175::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:43,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:43,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327243 s, 31.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:45,178::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:45,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:45,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:45,316::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425907 s, 24.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:47,187::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:47,192::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:47,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:47,382::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293184 s, 34.9 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:47,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:47,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00854878 s, 479 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:49,195::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:49,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:49,392::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:49,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298528 s, 34.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:51,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:51,210::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:51,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:51,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033015 s, 31.0 MB/s\n'; <rc> = 0
>Thread-533::DEBUG::2014-01-24 19:29:51,743::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-533::INFO::2014-01-24 19:29:51,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-533::INFO::2014-01-24 19:29:51,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-534::DEBUG::2014-01-24 19:29:51,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-534::INFO::2014-01-24 19:29:51,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-534::INFO::2014-01-24 19:29:51,753::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-535::DEBUG::2014-01-24 19:29:51,813::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-535::INFO::2014-01-24 19:29:51,814::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-535::INFO::2014-01-24 19:29:51,814::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-363::DEBUG::2014-01-24 19:29:52,883::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:29:52,889::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034305 s, 997 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:53,213::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:53,218::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:53,528::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:53,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311428 s, 32.9 MB/s\n'; <rc> = 0
>Thread-536::INFO::2014-01-24 19:29:54,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-536::INFO::2014-01-24 19:29:54,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00854878', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034305', 'lastCheck': '1.8', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:29:55,221::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:55,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:55,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:55,652::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289261 s, 35.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:57,230::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:57,235::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:57,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:57,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280964 s, 36.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:29:57,746::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:29:57,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000487506 s, 8.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:29:59,238::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:29:59,243::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:29:59,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:29:59,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265694 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:01,246::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:01,251::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:01,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-539::DEBUG::2014-01-24 19:30:01,837::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-539::INFO::2014-01-24 19:30:01,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-539::INFO::2014-01-24 19:30:01,841::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Dummy-233::DEBUG::2014-01-24 19:30:01,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339632 s, 30.2 MB/s\n'; <rc> = 0
>Thread-540::DEBUG::2014-01-24 19:30:01,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-540::INFO::2014-01-24 19:30:01,865::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-540::INFO::2014-01-24 19:30:01,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-541::DEBUG::2014-01-24 19:30:02,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-541::INFO::2014-01-24 19:30:02,050::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-541::INFO::2014-01-24 19:30:02,051::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-363::DEBUG::2014-01-24 19:30:02,898::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:02,905::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000324553 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:03,254::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:03,260::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:03,878::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:03,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292253 s, 35.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:05,263::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:05,270::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:05,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:06,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0314089 s, 32.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:07,272::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:07,278::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:07,758::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:07,768::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00411187 s, 996 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:08,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:08,079::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027545 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:09,281::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:09,287::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:10,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:10,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032951 s, 31.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:11,290::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:11,295::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-545::DEBUG::2014-01-24 19:30:12,050::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-545::INFO::2014-01-24 19:30:12,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-545::INFO::2014-01-24 19:30:12,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-546::DEBUG::2014-01-24 19:30:12,058::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-546::INFO::2014-01-24 19:30:12,058::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-546::INFO::2014-01-24 19:30:12,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-547::DEBUG::2014-01-24 19:30:12,097::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-547::INFO::2014-01-24 19:30:12,098::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-547::INFO::2014-01-24 19:30:12,098::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Dummy-233::DEBUG::2014-01-24 19:30:12,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:12,327::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267074 s, 38.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:30:12,915::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:12,921::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000311139 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:13,298::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:13,304::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-548::INFO::2014-01-24 19:30:13,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-548::INFO::2014-01-24 19:30:13,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00411187', 'lastCheck': '6.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000311139', 'lastCheck': '1.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:30:14,337::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:14,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333776 s, 30.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:15,307::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:15,312::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:16,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:16,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325248 s, 31.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:17,315::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:17,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:17,777::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:17,788::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00562427 s, 728 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:18,475::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:18,529::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027219 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:19,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:19,329::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:20,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:20,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0236807 s, 43.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:21,332::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:21,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-552::DEBUG::2014-01-24 19:30:22,096::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-552::INFO::2014-01-24 19:30:22,096::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-552::INFO::2014-01-24 19:30:22,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-553::DEBUG::2014-01-24 19:30:22,104::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-553::INFO::2014-01-24 19:30:22,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-553::INFO::2014-01-24 19:30:22,105::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:30:22,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:22,649::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264354 s, 38.7 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:30:22,929::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:22,935::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000375655 s, 910 kB/s\n'; <rc> = 0
>Thread-555::DEBUG::2014-01-24 19:30:23,243::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-555::INFO::2014-01-24 19:30:23,244::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-555::INFO::2014-01-24 19:30:23,244::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-12::DEBUG::2014-01-24 19:30:23,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:23,345::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:24,659::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:24,712::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265959 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:25,348::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:25,354::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:26,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:26,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358565 s, 28.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:27,357::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:27,363::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:27,794::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:27,804::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00388942 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:28,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:28,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561899 s, 18.2 MB/s\n'; <rc> = 0
>Thread-557::INFO::2014-01-24 19:30:29,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-557::INFO::2014-01-24 19:30:29,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00388942', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000375655', 'lastCheck': '6.2', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:30:29,366::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:29,371::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:30,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:30,944::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306184 s, 33.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:31,374::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:31,380::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 265.642 s, 40.4 MB/s']; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::misc::287::Storage.Misc::(validateDDBytes) err: ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 265.642 s, 40.4 MB/s'], size: 10737418240
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,238::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/529697b6-0f60-43c8-8fe1-ae01cfc536eb/e695cd65-e815-4ace-956d-7e24736a8a43 to /rhev/data-center/mnt/blockSD/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b DONE
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,239::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,626::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,651::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,654::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,661::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000561716 s, 911 kB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,661::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000561716 s, 911 kB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,664::volume::646::Storage.Volume::(setLegality) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b legality = LEGAL 
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,666::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,672::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000338321 s, 1.5 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,672::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000338321 s, 1.5 MB/s'], size: 512
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,675::image::778::Storage.Image::(copyCollapsed) Finished copying a250db32-9b39-4533-8bc6-926d4ae17535:e695cd65-e815-4ace-956d-7e24736a8a43 -> a250db32-9b39-4533-8bc6-926d4ae17535:228f2939-3615-4733-ae3c-fc37390a2d0b
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,675::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43 justme False
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,675::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/e695cd65-e815-4ace-956d-7e24736a8a43' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,792::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,793::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,887::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,891::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::INFO::2014-01-24 19:30:32,891::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b justme False
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:32,892::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:32,946::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:32,952::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000278593 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:32,953::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:33,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275893 s, 37.1 MB/s\n'; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,023::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,024::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,118::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a::DEBUG::2014-01-24 19:30:33,122::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-560::DEBUG::2014-01-24 19:30:33,253::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-560::INFO::2014-01-24 19:30:33,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-560::INFO::2014-01-24 19:30:33,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-561::DEBUG::2014-01-24 19:30:33,281::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-561::INFO::2014-01-24 19:30:33,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-561::INFO::2014-01-24 19:30:33,283::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:30:33,383::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:33,388::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:35,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:35,067::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252518 s, 40.6 MB/s\n'; <rc> = 0
>Thread-562::DEBUG::2014-01-24 19:30:35,208::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-562::INFO::2014-01-24 19:30:35,208::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-562::INFO::2014-01-24 19:30:35,208::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a'}}}
>Thread-564::DEBUG::2014-01-24 19:30:35,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [18bad2f6]
>Thread-564::INFO::2014-01-24 19:30:35,354::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None)
>Thread-564::INFO::2014-01-24 19:30:35,355::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b 
>Thread-564::DEBUG::2014-01-24 19:30:35,357::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-564::DEBUG::2014-01-24 19:30:35,362::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000566373 s, 904 kB/s\n'; <rc> = 0
>Thread-564::DEBUG::2014-01-24 19:30:35,363::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000566373 s, 904 kB/s'], size: 512
>Thread-564::DEBUG::2014-01-24 19:30:35,365::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-564::DEBUG::2014-01-24 19:30:35,370::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000491265 s, 1.0 MB/s\n'; <rc> = 0
>Thread-564::DEBUG::2014-01-24 19:30:35,371::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000491265 s, 1.0 MB/s'], size: 512
>Thread-564::INFO::2014-01-24 19:30:35,371::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-564::INFO::2014-01-24 19:30:35,371::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-12::DEBUG::2014-01-24 19:30:35,392::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:35,397::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-565::DEBUG::2014-01-24 19:30:35,478::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-565::INFO::2014-01-24 19:30:35,478::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='572cf2b3-c57b-40e2-84e6-3c7beb9d4a6a', spUUID=None, options=None)
>Thread-565::INFO::2014-01-24 19:30:35,479::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Dummy-233::DEBUG::2014-01-24 19:30:37,076::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:37,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027641 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:37,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:37,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:37,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:37,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576322 s, 7.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:39,139::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:39,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275936 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:39,407::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:39,413::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:41,201::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:41,251::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247306 s, 41.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:41,415::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:41,420::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:30:42,953::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:30:42,956::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:30:42,957::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-363::DEBUG::2014-01-24 19:30:42,962::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc']
>Thread-363::DEBUG::2014-01-24 19:30:42,963::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-363::INFO::2014-01-24 19:30:42,963::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered
>Thread-363::INFO::2014-01-24 19:30:42,964::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered
>Thread-363::DEBUG::2014-01-24 19:30:42,969::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:42,975::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000310485 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:43,260::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:43,313::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275074 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:43,423::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:43,428::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-569::INFO::2014-01-24 19:30:44,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-569::INFO::2014-01-24 19:30:44,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000576322', 'lastCheck': '6.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000310485', 'lastCheck': '1.3', 'valid': True}}
>Thread-571::DEBUG::2014-01-24 19:30:45,208::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-571::INFO::2014-01-24 19:30:45,208::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-571::INFO::2014-01-24 19:30:45,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-572::DEBUG::2014-01-24 19:30:45,231::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-572::INFO::2014-01-24 19:30:45,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-572::INFO::2014-01-24 19:30:45,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:30:45,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:45,375::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269613 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:45,431::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:45,436::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:47,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:47,434::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248298 s, 41.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:47,439::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:47,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:47,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:47,826::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000604611 s, 6.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:49,463::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:49,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:49,475::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:49,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267831 s, 38.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:51,478::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:51,483::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:51,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:51,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274078 s, 37.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:30:52,981::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:30:52,987::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00038025 s, 899 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:53,486::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:53,491::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:53,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:53,645::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272608 s, 37.6 MB/s\n'; <rc> = 0
>Thread-576::DEBUG::2014-01-24 19:30:55,333::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-576::INFO::2014-01-24 19:30:55,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-576::INFO::2014-01-24 19:30:55,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-577::DEBUG::2014-01-24 19:30:55,340::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-577::INFO::2014-01-24 19:30:55,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-577::INFO::2014-01-24 19:30:55,341::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:30:55,494::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:55,499::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:55,654::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:55,708::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274026 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:30:57,502::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:57,507::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:57,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:57,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288103 s, 35.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:30:57,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:30:57,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633663 s, 6.5 MB/s\n'; <rc> = 0
>Thread-579::INFO::2014-01-24 19:30:59,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-579::INFO::2014-01-24 19:30:59,501::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633663', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00038025', 'lastCheck': '6.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:30:59,510::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:30:59,515::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:30:59,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:30:59,833::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274851 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:01,517::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:01,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:01,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:01,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272558 s, 37.6 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:02,993::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:02,999::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000384565 s, 889 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:03,525::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:03,530::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:03,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:03,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276177 s, 37.1 MB/s\n'; <rc> = 0
>Thread-582::DEBUG::2014-01-24 19:31:05,399::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-582::INFO::2014-01-24 19:31:05,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-582::INFO::2014-01-24 19:31:05,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-583::DEBUG::2014-01-24 19:31:05,405::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-583::INFO::2014-01-24 19:31:05,405::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-583::INFO::2014-01-24 19:31:05,406::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:31:05,533::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:05,538::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:05,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:06,019::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027403 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:07,541::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:07,546::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:07,842::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:07,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627814 s, 6.5 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:08,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:08,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244315 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:09,549::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:09,554::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:10,087::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:10,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275181 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:11,557::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:11,562::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:12,149::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:12,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276941 s, 37.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:13,006::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:13,012::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000368311 s, 929 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:13,565::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:13,569::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:14,211::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:14,264::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275972 s, 37.1 MB/s\n'; <rc> = 0
>Thread-587::INFO::2014-01-24 19:31:14,729::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-587::INFO::2014-01-24 19:31:14,729::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627814', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368311', 'lastCheck': '1.7', 'valid': True}}
>Thread-589::DEBUG::2014-01-24 19:31:15,470::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-589::INFO::2014-01-24 19:31:15,470::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-589::INFO::2014-01-24 19:31:15,470::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-590::DEBUG::2014-01-24 19:31:15,476::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-590::INFO::2014-01-24 19:31:15,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-590::INFO::2014-01-24 19:31:15,477::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:31:15,572::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:15,577::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:16,273::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:16,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274274 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:17,580::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:17,585::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:17,851::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-120::DEBUG::2014-01-24 19:31:17,851::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:31:17,853::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:17,859::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000626598 s, 3.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:17,859::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000626598 s, 3.3 MB/s'], size: 2048
>Thread-120::DEBUG::2014-01-24 19:31:17,859::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-120::DEBUG::2014-01-24 19:31:17,859::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:31:17,860::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:18,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:18,518::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.134384 s, 7.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:19,588::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:19,593::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:20,114::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:20,115::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6']
>Thread-120::INFO::2014-01-24 19:31:20,115::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-120::INFO::2014-01-24 19:31:20,115::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-120::INFO::2014-01-24 19:31:20,116::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-120::DEBUG::2014-01-24 19:31:20,116::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:20,210::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:20,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:20,219::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528757 s, 7.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:20,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:20,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261956 s, 39.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:21,596::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:21,601::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:22,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:22,641::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273895 s, 37.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:23,018::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:23,024::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000314168 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:23,604::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:23,609::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:24,650::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:24,704::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280439 s, 36.5 MB/s\n'; <rc> = 0
>Thread-594::DEBUG::2014-01-24 19:31:25,531::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-594::INFO::2014-01-24 19:31:25,532::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-594::INFO::2014-01-24 19:31:25,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-595::DEBUG::2014-01-24 19:31:25,537::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-595::INFO::2014-01-24 19:31:25,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-595::INFO::2014-01-24 19:31:25,539::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:31:25,612::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:25,617::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:26,713::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:26,763::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247262 s, 41.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:27,620::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:27,625::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:28,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:28,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027644 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:29,627::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:29,632::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-597::INFO::2014-01-24 19:31:29,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-597::INFO::2014-01-24 19:31:29,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000528757', 'lastCheck': '9.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314168', 'lastCheck': '6.8', 'valid': True}}
>Thread-120::DEBUG::2014-01-24 19:31:30,224::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:30,229::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000613268 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:30,835::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:30,887::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272225 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:31,635::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:31,640::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:32,897::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:32,951::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248436 s, 41.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:33,031::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:33,037::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000341146 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:33,643::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:33,648::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:34,960::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:35,011::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271908 s, 37.7 MB/s\n'; <rc> = 0
>Thread-600::DEBUG::2014-01-24 19:31:35,596::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-600::INFO::2014-01-24 19:31:35,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-600::INFO::2014-01-24 19:31:35,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-601::DEBUG::2014-01-24 19:31:35,603::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-601::INFO::2014-01-24 19:31:35,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-601::INFO::2014-01-24 19:31:35,604::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:31:35,651::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:35,656::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:37,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:37,070::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276133 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:37,659::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:37,664::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:39,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:39,129::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244125 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:39,667::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:39,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:40,235::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:40,240::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000540273 s, 7.6 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:41,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:41,187::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234463 s, 43.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:41,674::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:41,679::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:43,045::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:43,050::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000296804 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:43,196::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:43,249::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272963 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:43,682::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:43,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-605::INFO::2014-01-24 19:31:45,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-605::INFO::2014-01-24 19:31:45,033::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540273', 'lastCheck': '4.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000296804', 'lastCheck': '2.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:31:45,258::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:45,311::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274594 s, 37.3 MB/s\n'; <rc> = 0
>Thread-607::DEBUG::2014-01-24 19:31:45,649::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-607::INFO::2014-01-24 19:31:45,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-607::INFO::2014-01-24 19:31:45,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-12::DEBUG::2014-01-24 19:31:45,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-608::DEBUG::2014-01-24 19:31:45,697::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-608::INFO::2014-01-24 19:31:45,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-12::DEBUG::2014-01-24 19:31:45,700::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-608::INFO::2014-01-24 19:31:45,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:31:47,320::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:47,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245587 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:47,710::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:47,715::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:49,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:49,431::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273611 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:49,718::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:49,723::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:31:50,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:31:50,251::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000608641 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:51,440::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:51,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269651 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:51,726::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:51,731::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:31:53,056::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:31:53,062::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000315865 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:53,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:53,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273655 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:53,734::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:53,738::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:55,563::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:55,615::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269304 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:55,741::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:55,746::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-612::DEBUG::2014-01-24 19:31:55,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-612::INFO::2014-01-24 19:31:55,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-612::INFO::2014-01-24 19:31:55,751::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-613::DEBUG::2014-01-24 19:31:55,757::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-613::INFO::2014-01-24 19:31:55,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-613::INFO::2014-01-24 19:31:55,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:31:57,625::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:57,674::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244334 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:57,750::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:57,757::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:31:59,683::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:31:59,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270432 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:31:59,760::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:31:59,765::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-615::INFO::2014-01-24 19:32:00,183::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-615::INFO::2014-01-24 19:32:00,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000608641', 'lastCheck': '9.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315865', 'lastCheck': '7.1', 'valid': True}}
>Thread-120::DEBUG::2014-01-24 19:32:00,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:00,262::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659213 s, 6.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:01,745::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:01,768::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:01,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:01,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448708 s, 22.8 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:03,069::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:03,075::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00037143 s, 921 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:03,788::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:03,793::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:03,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:03,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275091 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:05,796::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:05,801::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-618::DEBUG::2014-01-24 19:32:05,812::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-618::INFO::2014-01-24 19:32:05,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-618::INFO::2014-01-24 19:32:05,812::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-619::DEBUG::2014-01-24 19:32:05,818::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-619::INFO::2014-01-24 19:32:05,818::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-619::INFO::2014-01-24 19:32:05,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:32:05,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:05,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277639 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:07,804::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:07,809::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:07,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:08,001::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275264 s, 37.2 MB/s\n'; <rc> = 0
>Thread-621::DEBUG::2014-01-24 19:32:08,657::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-621::INFO::2014-01-24 19:32:08,658::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-621::INFO::2014-01-24 19:32:08,660::sd::582::Storage.StorageDomain::(getVMsList) vmList=[]
>Thread-621::INFO::2014-01-24 19:32:08,661::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[]
>Thread-621::INFO::2014-01-24 19:32:08,661::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}}
>Thread-12::DEBUG::2014-01-24 19:32:09,812::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:09,817::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:10,010::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:10,063::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02757 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:32:10,267::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:10,274::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000522786 s, 7.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:11,819::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:11,824::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:12,072::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:12,125::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269641 s, 38.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:13,082::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:13,088::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328456 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:13,827::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:13,832::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:14,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:14,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243479 s, 42.1 MB/s\n'; <rc> = 0
>Thread-624::DEBUG::2014-01-24 19:32:14,256::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae]
>Thread-624::INFO::2014-01-24 19:32:14,256::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None)
>Thread-624::DEBUG::2014-01-24 19:32:14,257::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-624::DEBUG::2014-01-24 19:32:14,352::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-624::DEBUG::2014-01-24 19:32:14,357::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-624::INFO::2014-01-24 19:32:14,358::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b 
>Thread-624::DEBUG::2014-01-24 19:32:14,360::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-624::DEBUG::2014-01-24 19:32:14,366::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000536287 s, 955 kB/s\n'; <rc> = 0
>Thread-624::DEBUG::2014-01-24 19:32:14,366::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000536287 s, 955 kB/s'], size: 512
>Thread-624::DEBUG::2014-01-24 19:32:14,368::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-624::DEBUG::2014-01-24 19:32:14,373::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000491784 s, 1.0 MB/s\n'; <rc> = 0
>Thread-624::DEBUG::2014-01-24 19:32:14,374::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000491784 s, 1.0 MB/s'], size: 512
>Thread-624::INFO::2014-01-24 19:32:14,374::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-624::INFO::2014-01-24 19:32:14,374::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-625::DEBUG::2014-01-24 19:32:14,384::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae]
>Thread-625::INFO::2014-01-24 19:32:14,384::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None)
>Thread-625::INFO::2014-01-24 19:32:14,397::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': []}
>Thread-626::DEBUG::2014-01-24 19:32:14,411::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [584fedae]
>Thread-626::INFO::2014-01-24 19:32:14,411::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-626::INFO::2014-01-24 19:32:14,412::sd::582::Storage.StorageDomain::(getVMsList) vmList=[]
>Thread-626::INFO::2014-01-24 19:32:14,412::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[]
>Thread-626::INFO::2014-01-24 19:32:14,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}}
>Thread-627::DEBUG::2014-01-24 19:32:14,717::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1d54c437]
>Thread-627::INFO::2014-01-24 19:32:14,717::logUtils::44::dispatcher::(wrapper) Run and protect: copyImage(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmUUID='', srcImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', srcVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', dstImgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', dstVolUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', description='', dstSdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', volType=6, volFormat=5, preallocate=1, postZero='false', force='false')
>Thread-627::DEBUG::2014-01-24 19:32:14,717::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-627::DEBUG::2014-01-24 19:32:14,810::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-627::DEBUG::2014-01-24 19:32:14,814::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-627::INFO::2014-01-24 19:32:14,814::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain a250db32-9b39-4533-8bc6-926d4ae17535 has vollist ['228f2939-3615-4733-ae3c-fc37390a2d0b']
>Thread-627::DEBUG::2014-01-24 19:32:14,816::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-627::DEBUG::2014-01-24 19:32:14,822::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000404974 s, 1.3 MB/s\n'; <rc> = 0
>Thread-627::DEBUG::2014-01-24 19:32:14,822::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000404974 s, 1.3 MB/s'], size: 512
>Thread-627::DEBUG::2014-01-24 19:32:14,824::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-627::DEBUG::2014-01-24 19:32:14,830::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000436804 s, 1.2 MB/s\n'; <rc> = 0
>Thread-627::DEBUG::2014-01-24 19:32:14,830::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000436804 s, 1.2 MB/s'], size: 512
>Thread-627::DEBUG::2014-01-24 19:32:14,830::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-627::DEBUG::2014-01-24 19:32:14,924::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-627::DEBUG::2014-01-24 19:32:14,928::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-627::DEBUG::2014-01-24 19:32:14,931::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-627::DEBUG::2014-01-24 19:32:14,936::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000551467 s, 928 kB/s\n'; <rc> = 0
>Thread-627::DEBUG::2014-01-24 19:32:14,937::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000551467 s, 928 kB/s'], size: 512
>Thread-627::INFO::2014-01-24 19:32:14,967::logUtils::47::dispatcher::(wrapper) Run and protect: copyImage, Return response: None
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,038::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,131::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,135::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,137::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,143::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000500758 s, 1.0 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,143::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000500758 s, 1.0 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,145::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image df30ebf7-0d71-40b0-a33e-07170bdead7d does not exist in domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,146::image::645::Storage.Image::(copyCollapsed) sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 vmUUID= srcImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d srcVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstImgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d dstVolUUID=228f2939-3615-4733-ae3c-fc37390a2d0b dstSdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e volType=6 volFormat=RAW preallocate=PREALLOCATED force=False postZero=False
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,148::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,153::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000509018 s, 1.0 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,154::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000509018 s, 1.0 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,156::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,161::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000498594 s, 1.0 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,161::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000498594 s, 1.0 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,163::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,169::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000367899 s, 1.4 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,169::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000367899 s, 1.4 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,171::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,176::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000370651 s, 1.4 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,177::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000370651 s, 1.4 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,179::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,184::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000418972 s, 1.2 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,184::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000418972 s, 1.2 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,187::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,192::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000344267 s, 1.5 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,192::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000344267 s, 1.5 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,192::image::695::Storage.Image::(copyCollapsed) copy source a250db32-9b39-4533-8bc6-926d4ae17535:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b vol size 20971520 destination 464da998-ebd2-46a1-bab0-1c02a21a165e:df30ebf7-0d71-40b0-a33e-07170bdead7d:228f2939-3615-4733-ae3c-fc37390a2d0b apparentsize 20971520
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,193::image::285::Storage.Image::(isLegal) image df30ebf7-0d71-40b0-a33e-07170bdead7d in domain 464da998-ebd2-46a1-bab0-1c02a21a165e has vollist []
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,193::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d for image's volumes
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,230::volume::443::Storage.Volume::(create) Creating volume 228f2939-3615-4733-ae3c-fc37390a2d0b
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,333::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10 oflag=direct' (cwd None)
>Thread-628::INFO::2014-01-24 19:32:15,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-628::INFO::2014-01-24 19:32:15,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000522786', 'lastCheck': '5.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328456', 'lastCheck': '2.3', 'valid': True}}
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,683::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10+0 records in', '10+0 records out', '10485760 bytes (10 MB) copied, 0.326709 s, 32.1 MB/s']; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,683::misc::287::Storage.Misc::(validateDDBytes) err: ['10+0 records in', '10+0 records out', '10485760 bytes (10 MB) copied, 0.326709 s, 32.1 MB/s'], size: 10485760
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,683::fileVolume::144::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b with size = 20480 sectors
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,764::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 228f2939-3615-4733-ae3c-fc37390a2d0b
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:15,773::volume::789::Storage.Volume::(prepare) Volume: preparing volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,775::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,781::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000450689 s, 1.1 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,781::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000450689 s, 1.1 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available y a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:15,835::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:15,842::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-630::DEBUG::2014-01-24 19:32:15,883::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-630::INFO::2014-01-24 19:32:15,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-630::INFO::2014-01-24 19:32:15,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-631::DEBUG::2014-01-24 19:32:15,889::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-631::INFO::2014-01-24 19:32:15,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-631::INFO::2014-01-24 19:32:15,890::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144349265920', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,951::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:15,952::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,046::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,051::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,053::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,059::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000459774 s, 1.1 MB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,059::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000459774 s, 1.1 MB/s'], size: 512
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:32:16,059::volume::789::Storage.Volume::(prepare) Volume: preparing volume 464da998-ebd2-46a1-bab0-1c02a21a165e/228f2939-3615-4733-ae3c-fc37390a2d0b
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,092::volume::1094::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) to /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b (raw) START
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:32:16,095::utils::596::Storage.Misc.excCmd::(watchCmd) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b of=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b bs=1048576 seek=0 skip=0 conv=notrunc count=10240 oflag=direct' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:16,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:16,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286536 s, 35.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:17,847::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:17,853::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:18,257::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:18,312::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281437 s, 36.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:19,856::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:19,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:32:20,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:20,286::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000780496 s, 5.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:20,321::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:20,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028168 s, 36.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:21,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:21,871::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:22,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:22,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266579 s, 38.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:23,270::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:23,283::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00389469 s, 87.8 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:23,874::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:23,880::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:24,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:24,502::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271936 s, 37.7 MB/s\n'; <rc> = 0
>Thread-634::DEBUG::2014-01-24 19:32:25,248::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-634::INFO::2014-01-24 19:32:25,248::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-634::INFO::2014-01-24 19:32:25,249::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:32:25,883::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:25,889::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-636::DEBUG::2014-01-24 19:32:25,935::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-636::INFO::2014-01-24 19:32:25,935::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-636::INFO::2014-01-24 19:32:25,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-637::DEBUG::2014-01-24 19:32:25,942::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-637::INFO::2014-01-24 19:32:25,942::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-637::INFO::2014-01-24 19:32:25,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '144096952320', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:32:26,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:26,588::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388022 s, 26.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:27,892::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:27,899::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:28,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:28,803::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0313581 s, 32.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:29,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:29,908::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:32:30,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:30,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609473 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:30,816::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:30,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03253 s, 31.5 MB/s\n'; <rc> = 0
>Thread-639::INFO::2014-01-24 19:32:31,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-639::INFO::2014-01-24 19:32:31,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000609473', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00389469', 'lastCheck': '8.3', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:32:31,911::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:31,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:32,885::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:32,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246869 s, 41.5 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:33,290::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:33,300::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000316303 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:33,920::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:33,926::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:34,947::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:35,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312155 s, 32.8 MB/s\n'; <rc> = 0
>Thread-642::DEBUG::2014-01-24 19:32:35,258::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-642::INFO::2014-01-24 19:32:35,258::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-642::INFO::2014-01-24 19:32:35,258::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:32:35,929::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:35,935::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-643::DEBUG::2014-01-24 19:32:36,106::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-643::INFO::2014-01-24 19:32:36,107::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-643::INFO::2014-01-24 19:32:36,107::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-644::DEBUG::2014-01-24 19:32:36,114::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-644::INFO::2014-01-24 19:32:36,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-644::INFO::2014-01-24 19:32:36,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '143585509376', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:32:37,016::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:37,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275486 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:37,938::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:37,944::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:39,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:39,137::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028972 s, 35.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:39,947::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:39,953::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:32:40,303::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:40,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00730193 s, 561 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:41,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:41,204::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289547 s, 35.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:41,956::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:41,962::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:43,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:43,268::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027532 s, 37.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:43,312::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:43,318::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000319081 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:43,965::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:43,971::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-648::DEBUG::2014-01-24 19:32:45,266::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-648::INFO::2014-01-24 19:32:45,266::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-648::INFO::2014-01-24 19:32:45,267::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:32:45,278::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:45,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279901 s, 36.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:45,974::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:45,980::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-649::DEBUG::2014-01-24 19:32:46,168::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-649::INFO::2014-01-24 19:32:46,168::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-649::INFO::2014-01-24 19:32:46,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-650::DEBUG::2014-01-24 19:32:46,174::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-650::INFO::2014-01-24 19:32:46,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-650::INFO::2014-01-24 19:32:46,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '143037890560', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-651::INFO::2014-01-24 19:32:46,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-651::INFO::2014-01-24 19:32:46,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00730193', 'lastCheck': '6.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000319081', 'lastCheck': '3.5', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:32:47,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:47,396::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248655 s, 41.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:47,983::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:47,990::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:49,405::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:49,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267928 s, 38.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:49,993::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:49,998::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:32:50,322::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:32:50,333::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00475881 s, 861 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:51,469::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:51,524::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278288 s, 36.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:52,001::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:52,007::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:32:53,327::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:32:53,334::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000274692 s, 1.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:53,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:53,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278732 s, 36.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:54,010::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:54,016::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-655::DEBUG::2014-01-24 19:32:55,274::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-655::INFO::2014-01-24 19:32:55,275::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-655::INFO::2014-01-24 19:32:55,275::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:32:55,599::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:55,653::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275353 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:56,019::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:56,025::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-657::DEBUG::2014-01-24 19:32:56,222::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-657::INFO::2014-01-24 19:32:56,223::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-657::INFO::2014-01-24 19:32:56,223::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-658::DEBUG::2014-01-24 19:32:56,228::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-658::INFO::2014-01-24 19:32:56,228::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-658::INFO::2014-01-24 19:32:56,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '142558658560', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:32:57,663::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:57,715::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242273 s, 42.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:32:58,028::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:32:58,034::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:32:59,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:32:59,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276318 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:00,037::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:00,042::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:00,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:00,346::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00171051 s, 2.4 MB/s\n'; <rc> = 0
>Thread-660::DEBUG::2014-01-24 19:33:01,473::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-660::INFO::2014-01-24 19:33:01,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-660::INFO::2014-01-24 19:33:01,479::sd::582::Storage.StorageDomain::(getVMsList) vmList=[]
>Thread-660::INFO::2014-01-24 19:33:01,479::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[]
>Thread-660::INFO::2014-01-24 19:33:01,479::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}}
>Dummy-233::DEBUG::2014-01-24 19:33:01,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:01,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271546 s, 37.7 MB/s\n'; <rc> = 0
>Thread-661::INFO::2014-01-24 19:33:02,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-661::INFO::2014-01-24 19:33:02,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171051', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000274692', 'lastCheck': '8.7', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:33:02,046::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:02,051::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-663::DEBUG::2014-01-24 19:33:03,541::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-663::INFO::2014-01-24 19:33:03,542::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-363::DEBUG::2014-01-24 19:33:03,555::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:03,562::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000333791 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:03,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:03,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276184 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:04,055::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:04,060::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-663::INFO::2014-01-24 19:33:04,536::sd::582::Storage.StorageDomain::(getVMsList) vmList=[]
>Thread-663::INFO::2014-01-24 19:33:04,537::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=[]
>Thread-663::INFO::2014-01-24 19:33:04,537::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {}}
>Thread-665::DEBUG::2014-01-24 19:33:05,283::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-665::INFO::2014-01-24 19:33:05,284::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-665::INFO::2014-01-24 19:33:05,284::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:33:05,921::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:05,975::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266474 s, 38.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:06,064::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:06,069::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-666::DEBUG::2014-01-24 19:33:06,274::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-666::INFO::2014-01-24 19:33:06,275::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-666::INFO::2014-01-24 19:33:06,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-667::DEBUG::2014-01-24 19:33:06,305::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-667::INFO::2014-01-24 19:33:06,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-667::INFO::2014-01-24 19:33:06,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '141998227456', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:33:07,988::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:08,046::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319895 s, 32.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:08,072::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:08,077::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:10,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:10,081::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:10,091::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:10,134::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498976 s, 20.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:10,352::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:10,359::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788294 s, 5.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:12,104::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:12,110::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:12,143::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:12,198::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273356 s, 37.5 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:33:13,602::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:13,609::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328964 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:14,114::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:14,120::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:14,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:14,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305274 s, 33.5 MB/s\n'; <rc> = 0
>Thread-671::DEBUG::2014-01-24 19:33:15,291::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-671::INFO::2014-01-24 19:33:15,292::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-671::INFO::2014-01-24 19:33:15,292::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:33:16,123::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:16,129::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:16,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:16,333::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291405 s, 35.1 MB/s\n'; <rc> = 0
>Thread-672::DEBUG::2014-01-24 19:33:16,459::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-672::INFO::2014-01-24 19:33:16,460::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-672::INFO::2014-01-24 19:33:16,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-673::DEBUG::2014-01-24 19:33:16,469::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-673::INFO::2014-01-24 19:33:16,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-673::INFO::2014-01-24 19:33:16,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '141499924480', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-674::INFO::2014-01-24 19:33:17,229::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-674::INFO::2014-01-24 19:33:17,229::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788294', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328964', 'lastCheck': '3.6', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:33:18,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:18,138::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:18,343::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:18,398::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274078 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:20,141::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:20,147::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:20,370::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:20,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000857771 s, 4.8 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:20,407::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:20,465::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271696 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:22,150::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:22,156::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:22,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:22,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026939 s, 38.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:33:23,620::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:23,626::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000303332 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:24,159::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:24,164::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:24,540::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:24,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267149 s, 38.3 MB/s\n'; <rc> = 0
>Thread-678::DEBUG::2014-01-24 19:33:25,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-678::INFO::2014-01-24 19:33:25,305::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-678::INFO::2014-01-24 19:33:25,305::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:33:26,167::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:26,174::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-680::DEBUG::2014-01-24 19:33:26,533::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-680::INFO::2014-01-24 19:33:26,533::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-680::INFO::2014-01-24 19:33:26,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-681::DEBUG::2014-01-24 19:33:26,540::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-681::INFO::2014-01-24 19:33:26,541::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-681::INFO::2014-01-24 19:33:26,542::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140934479872', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:33:26,603::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:26,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270368 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:28,177::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:28,182::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:28,666::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:28,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269772 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:30,185::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:30,191::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:30,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:30,388::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569969 s, 7.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:30,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:30,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284445 s, 36.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:32,194::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:32,200::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-683::INFO::2014-01-24 19:33:32,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-683::INFO::2014-01-24 19:33:32,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569969', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303332', 'lastCheck': '8.8', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:33:32,797::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:32,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274297 s, 37.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:33:33,634::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:33,648::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000329111 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:34,203::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:34,209::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:34,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:34,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029118 s, 35.2 MB/s\n'; <rc> = 0
>Thread-685::DEBUG::2014-01-24 19:33:35,315::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-685::INFO::2014-01-24 19:33:35,315::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-685::INFO::2014-01-24 19:33:35,316::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:33:36,212::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:36,218::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-687::DEBUG::2014-01-24 19:33:36,646::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-687::INFO::2014-01-24 19:33:36,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-687::INFO::2014-01-24 19:33:36,647::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-688::DEBUG::2014-01-24 19:33:36,653::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-688::INFO::2014-01-24 19:33:36,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-688::INFO::2014-01-24 19:33:36,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140467634176', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:33:36,929::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:36,987::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317844 s, 32.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:38,221::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:38,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:38,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:39,052::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276227 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:40,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:40,235::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:40,394::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:40,401::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000467485 s, 8.8 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:41,061::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:41,114::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265756 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:42,238::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:42,244::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:43,124::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:43,179::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274186 s, 37.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:33:43,663::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:43,670::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000305558 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:44,247::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:44,253::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:45,189::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:45,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291725 s, 35.1 MB/s\n'; <rc> = 0
>Thread-692::DEBUG::2014-01-24 19:33:45,353::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-692::INFO::2014-01-24 19:33:45,353::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-692::INFO::2014-01-24 19:33:45,354::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:33:46,256::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:46,262::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-693::DEBUG::2014-01-24 19:33:46,717::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-693::INFO::2014-01-24 19:33:46,717::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-693::INFO::2014-01-24 19:33:46,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-694::DEBUG::2014-01-24 19:33:46,724::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-694::INFO::2014-01-24 19:33:46,724::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-694::INFO::2014-01-24 19:33:46,726::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '140025069568', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:33:47,254::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:47,309::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264759 s, 38.7 MB/s\n'; <rc> = 0
>Thread-695::INFO::2014-01-24 19:33:47,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-695::INFO::2014-01-24 19:33:47,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000467485', 'lastCheck': '7.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000305558', 'lastCheck': '3.9', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:33:48,265::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:48,271::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:49,319::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:49,374::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276838 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:50,274::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:50,280::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:33:50,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:33:50,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709214 s, 5.8 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:51,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:51,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290596 s, 35.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:52,283::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:52,288::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:53,448::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:53,504::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285457 s, 35.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:33:53,687::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:33:53,694::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000637782 s, 536 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:54,291::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:54,297::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-699::DEBUG::2014-01-24 19:33:55,376::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-699::INFO::2014-01-24 19:33:55,376::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-699::INFO::2014-01-24 19:33:55,376::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:33:55,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:55,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349918 s, 29.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:56,300::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:56,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-700::DEBUG::2014-01-24 19:33:56,785::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-700::INFO::2014-01-24 19:33:56,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-700::INFO::2014-01-24 19:33:56,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-701::DEBUG::2014-01-24 19:33:56,792::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-701::INFO::2014-01-24 19:33:56,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-701::INFO::2014-01-24 19:33:56,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '139624153088', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:33:57,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:57,639::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285026 s, 35.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:33:58,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:33:58,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:33:59,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:33:59,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.023948 s, 42.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:00,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:00,322::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:00,418::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:34:00,425::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673859 s, 6.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:01,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:01,773::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331499 s, 30.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:02,325::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:02,331::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-704::INFO::2014-01-24 19:34:02,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-704::INFO::2014-01-24 19:34:02,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673859', 'lastCheck': '2.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000637782', 'lastCheck': '9.2', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:34:03,712::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:03,719::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034759 s, 984 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:03,783::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:03,841::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0298949 s, 34.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:04,334::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:04,340::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-706::DEBUG::2014-01-24 19:34:05,384::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-706::INFO::2014-01-24 19:34:05,384::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-706::INFO::2014-01-24 19:34:05,385::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:34:05,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:05,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277666 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:06,343::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:06,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-708::DEBUG::2014-01-24 19:34:06,843::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-708::INFO::2014-01-24 19:34:06,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-708::INFO::2014-01-24 19:34:06,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-709::DEBUG::2014-01-24 19:34:06,851::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-709::INFO::2014-01-24 19:34:06,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-709::INFO::2014-01-24 19:34:06,853::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '139211866112', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:34:07,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:07,969::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272281 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:08,352::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:08,358::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:09,979::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:10,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309266 s, 33.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:10,361::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:10,366::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:10,430::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:34:10,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000614446 s, 6.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:12,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:12,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028408 s, 36.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:12,369::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:12,375::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:34:13,730::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:13,736::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000312952 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:14,111::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:14,166::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277424 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:14,378::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:14,384::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-713::DEBUG::2014-01-24 19:34:15,400::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-713::INFO::2014-01-24 19:34:15,401::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-713::INFO::2014-01-24 19:34:15,401::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:34:16,175::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:16,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274417 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:16,387::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:16,393::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-714::DEBUG::2014-01-24 19:34:16,910::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-714::INFO::2014-01-24 19:34:16,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-714::INFO::2014-01-24 19:34:16,911::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-715::DEBUG::2014-01-24 19:34:16,918::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-715::INFO::2014-01-24 19:34:16,918::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-715::INFO::2014-01-24 19:34:16,919::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '138804822016', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-716::INFO::2014-01-24 19:34:18,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-716::INFO::2014-01-24 19:34:18,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000614446', 'lastCheck': '7.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000312952', 'lastCheck': '4.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:34:18,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:18,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246897 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:18,396::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:18,402::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:20,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:20,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244103 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:20,405::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:20,410::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:20,441::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:34:20,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00204618 s, 2.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:22,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:22,414::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:22,425::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:22,443::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303951 s, 33.7 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:34:23,743::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:23,756::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00375401 s, 91.1 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:24,437::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:24,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:24,452::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:24,505::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268523 s, 38.1 MB/s\n'; <rc> = 0
>Thread-720::DEBUG::2014-01-24 19:34:25,409::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-720::INFO::2014-01-24 19:34:25,409::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-720::INFO::2014-01-24 19:34:25,409::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:34:26,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:26,452::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:26,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:26,569::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282501 s, 36.2 MB/s\n'; <rc> = 0
>Thread-721::DEBUG::2014-01-24 19:34:26,972::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-721::INFO::2014-01-24 19:34:26,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-721::INFO::2014-01-24 19:34:26,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-722::DEBUG::2014-01-24 19:34:26,977::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-722::INFO::2014-01-24 19:34:26,978::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-722::INFO::2014-01-24 19:34:26,979::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '138331160576', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:34:28,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:28,461::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:28,578::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:28,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274963 s, 37.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:30,455::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:30,464::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:30,476::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:30,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473304 s, 865 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:30,642::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:30,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271033 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:32,491::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:32,497::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:32,706::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:32,761::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273861 s, 37.4 MB/s\n'; <rc> = 0
>Thread-725::INFO::2014-01-24 19:34:33,205::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-725::INFO::2014-01-24 19:34:33,205::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473304', 'lastCheck': '2.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00375401', 'lastCheck': '9.4', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:34:33,764::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:33,778::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00117247 s, 292 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:34,500::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:34,506::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:34,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:34,826::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275805 s, 37.1 MB/s\n'; <rc> = 0
>Thread-727::DEBUG::2014-01-24 19:34:35,419::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-727::INFO::2014-01-24 19:34:35,419::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-727::INFO::2014-01-24 19:34:35,419::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:34:36,509::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:36,515::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:36,839::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:36,894::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274924 s, 37.2 MB/s\n'; <rc> = 0
>Thread-729::DEBUG::2014-01-24 19:34:37,036::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-729::INFO::2014-01-24 19:34:37,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-729::INFO::2014-01-24 19:34:37,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-730::DEBUG::2014-01-24 19:34:37,046::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-730::INFO::2014-01-24 19:34:37,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-730::INFO::2014-01-24 19:34:37,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '137878470656', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:34:38,518::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:38,523::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:38,903::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:38,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275808 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:40,496::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:34:40,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000910559 s, 4.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:40,526::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:40,532::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:40,968::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:41,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352098 s, 29.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:42,535::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:42,541::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:43,040::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:43,092::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263489 s, 38.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:34:43,790::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:43,796::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000270114 s, 1.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:44,544::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:44,549::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:45,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:45,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265174 s, 38.6 MB/s\n'; <rc> = 0
>Thread-734::DEBUG::2014-01-24 19:34:45,428::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-734::INFO::2014-01-24 19:34:45,428::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-734::INFO::2014-01-24 19:34:45,429::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:34:46,552::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:46,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:47,165::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-735::DEBUG::2014-01-24 19:34:47,192::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-735::INFO::2014-01-24 19:34:47,194::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-735::INFO::2014-01-24 19:34:47,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-736::DEBUG::2014-01-24 19:34:47,205::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-736::INFO::2014-01-24 19:34:47,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-736::INFO::2014-01-24 19:34:47,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '137373876224', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:34:47,237::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456084 s, 22.5 MB/s\n'; <rc> = 0
>Thread-737::INFO::2014-01-24 19:34:48,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-737::INFO::2014-01-24 19:34:48,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910559', 'lastCheck': '7.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000270114', 'lastCheck': '4.6', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:34:48,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:48,611::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:49,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:49,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341799 s, 30.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:34:50,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:34:50,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00512707 s, 799 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:50,614::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:50,620::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:51,332::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:51,387::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271926 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:52,623::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:52,628::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:53,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:53,449::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243802 s, 42.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:34:53,804::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:34:53,814::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00103514 s, 330 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:54,631::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:54,636::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-741::DEBUG::2014-01-24 19:34:55,446::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-741::INFO::2014-01-24 19:34:55,447::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-741::INFO::2014-01-24 19:34:55,447::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:34:55,458::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:55,514::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280766 s, 36.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:56,639::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:56,645::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-742::DEBUG::2014-01-24 19:34:57,258::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-742::INFO::2014-01-24 19:34:57,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-742::INFO::2014-01-24 19:34:57,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-743::DEBUG::2014-01-24 19:34:57,264::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-743::INFO::2014-01-24 19:34:57,265::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-743::INFO::2014-01-24 19:34:57,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '136965783552', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:34:57,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:57,575::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026564 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:34:58,648::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:34:58,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:34:59,585::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:34:59,636::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242085 s, 42.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:35:00,525::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:00,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000431949 s, 9.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:00,657::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:00,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:01,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:01,701::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274848 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:02,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:02,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-746::INFO::2014-01-24 19:35:03,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-746::INFO::2014-01-24 19:35:03,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000431949', 'lastCheck': '3.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00103514', 'lastCheck': '9.9', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:35:03,710::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:03,765::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272518 s, 37.6 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:03,823::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:03,832::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000310336 s, 1.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:04,675::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:04,680::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-748::DEBUG::2014-01-24 19:35:05,474::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-748::INFO::2014-01-24 19:35:05,474::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-748::INFO::2014-01-24 19:35:05,474::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:35:05,775::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:05,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244286 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:06,684::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:06,689::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-750::DEBUG::2014-01-24 19:35:07,321::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-750::INFO::2014-01-24 19:35:07,321::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-750::INFO::2014-01-24 19:35:07,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-751::DEBUG::2014-01-24 19:35:07,359::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-751::INFO::2014-01-24 19:35:07,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-751::INFO::2014-01-24 19:35:07,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '136453816320', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:35:07,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:07,892::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278432 s, 36.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:08,692::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:08,698::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:09,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:09,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273352 s, 37.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:35:10,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:10,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00248918 s, 1.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:10,701::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:10,707::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:11,967::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:12,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235727 s, 43.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:12,710::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:12,716::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:13,840::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:13,847::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000314732 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:14,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:14,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269514 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:14,719::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:14,725::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-754::DEBUG::2014-01-24 19:35:15,482::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-754::INFO::2014-01-24 19:35:15,483::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-754::INFO::2014-01-24 19:35:15,483::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:35:16,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:16,150::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318635 s, 32.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:16,728::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:16,733::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-756::DEBUG::2014-01-24 19:35:17,446::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-756::INFO::2014-01-24 19:35:17,446::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-756::INFO::2014-01-24 19:35:17,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-757::DEBUG::2014-01-24 19:35:17,452::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-757::INFO::2014-01-24 19:35:17,452::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-757::INFO::2014-01-24 19:35:17,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '135868416000', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:35:18,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:18,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024307 s, 42.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:18,736::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:18,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-758::INFO::2014-01-24 19:35:18,806::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-758::INFO::2014-01-24 19:35:18,806::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00248918', 'lastCheck': '8.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000314732', 'lastCheck': '5.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:35:20,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:20,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243783 s, 42.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:35:20,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:20,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000439539 s, 9.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:20,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:20,751::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:22,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:22,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026066 s, 39.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:22,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:22,760::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:23,855::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:23,861::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000362192 s, 944 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:24,345::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:24,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277695 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:24,763::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:24,769::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-762::DEBUG::2014-01-24 19:35:25,494::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-762::INFO::2014-01-24 19:35:25,494::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-762::INFO::2014-01-24 19:35:25,495::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:35:26,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:26,466::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288584 s, 35.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:26,772::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:26,778::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-763::DEBUG::2014-01-24 19:35:27,565::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-763::INFO::2014-01-24 19:35:27,565::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-763::INFO::2014-01-24 19:35:27,565::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-764::DEBUG::2014-01-24 19:35:27,572::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-764::INFO::2014-01-24 19:35:27,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-764::INFO::2014-01-24 19:35:27,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '135355170816', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:35:28,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:28,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304992 s, 33.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:28,781::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:28,786::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:30,542::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:30,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:30,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000918078 s, 4.5 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:30,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0764724 s, 13.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:30,789::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:30,795::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:32,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:32,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324698 s, 31.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:32,798::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:32,804::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:33,872::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:33,878::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000313406 s, 1.1 MB/s\n'; <rc> = 0
>Thread-767::INFO::2014-01-24 19:35:34,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-767::INFO::2014-01-24 19:35:34,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000918078', 'lastCheck': '3.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000313406', 'lastCheck': '0.2', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:35:34,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:34,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272044 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:34,807::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:34,813::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-769::DEBUG::2014-01-24 19:35:35,502::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-769::INFO::2014-01-24 19:35:35,502::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-769::INFO::2014-01-24 19:35:35,502::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:35:36,790::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:36,816::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:36,826::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:36,867::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048885 s, 20.9 MB/s\n'; <rc> = 0
>Thread-771::DEBUG::2014-01-24 19:35:37,619::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-771::INFO::2014-01-24 19:35:37,620::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-771::INFO::2014-01-24 19:35:37,620::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-772::DEBUG::2014-01-24 19:35:37,646::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-772::INFO::2014-01-24 19:35:37,646::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-772::INFO::2014-01-24 19:35:37,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '134877020160', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:35:38,839::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:38,845::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:38,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:38,939::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356187 s, 28.7 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:35:40,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:40,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00559322 s, 732 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:40,848::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:40,854::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:40,949::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:41,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028187 s, 36.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:42,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:42,863::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:43,014::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:43,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027645 s, 37.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:43,880::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:35:43,883::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:35:43,884::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-363::DEBUG::2014-01-24 19:35:43,897::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc']
>Thread-363::DEBUG::2014-01-24 19:35:43,898::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-363::INFO::2014-01-24 19:35:43,898::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered
>Thread-363::INFO::2014-01-24 19:35:43,899::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered
>Thread-363::DEBUG::2014-01-24 19:35:43,904::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:43,922::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00432184 s, 79.1 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:44,866::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:44,872::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:45,081::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:45,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342255 s, 29.9 MB/s\n'; <rc> = 0
>Thread-776::DEBUG::2014-01-24 19:35:45,512::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-776::INFO::2014-01-24 19:35:45,512::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-776::INFO::2014-01-24 19:35:45,512::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-12::DEBUG::2014-01-24 19:35:46,875::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:46,881::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:47,154::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:47,209::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274784 s, 37.3 MB/s\n'; <rc> = 0
>Thread-778::DEBUG::2014-01-24 19:35:47,699::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-778::INFO::2014-01-24 19:35:47,699::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-778::INFO::2014-01-24 19:35:47,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-779::DEBUG::2014-01-24 19:35:47,705::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-779::INFO::2014-01-24 19:35:47,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-779::INFO::2014-01-24 19:35:47,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '134474170368', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:35:48,884::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:48,889::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:49,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-780::INFO::2014-01-24 19:35:49,226::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-780::INFO::2014-01-24 19:35:49,227::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00559322', 'lastCheck': '8.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00432184', 'lastCheck': '5.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:35:49,436::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339204 s, 30.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:35:50,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:35:50,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00496484 s, 825 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:50,893::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:50,898::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:51,445::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:51,500::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277135 s, 36.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:52,902::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:52,907::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:53,510::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:53,562::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252679 s, 40.5 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:35:53,930::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:35:53,939::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033572 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:54,910::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:54,916::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-784::DEBUG::2014-01-24 19:35:55,521::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-784::INFO::2014-01-24 19:35:55,522::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-784::INFO::2014-01-24 19:35:55,522::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Dummy-233::DEBUG::2014-01-24 19:35:55,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:55,627::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273013 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:35:56,919::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:56,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:57,637::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:57,692::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027535 s, 37.2 MB/s\n'; <rc> = 0
>Thread-785::DEBUG::2014-01-24 19:35:57,752::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-785::INFO::2014-01-24 19:35:57,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-785::INFO::2014-01-24 19:35:57,753::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-786::DEBUG::2014-01-24 19:35:57,758::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-786::INFO::2014-01-24 19:35:57,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-786::INFO::2014-01-24 19:35:57,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133926551552', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:35:58,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:35:58,934::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:35:59,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:35:59,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024062 s, 42.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:00,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:00,758::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0479823 s, 85.4 kB/s\n'; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,837::utils::610::Storage.Misc.excCmd::(watchCmd) SUCCESS: <err> = ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 224.736 s, 47.8 MB/s']; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,837::misc::287::Storage.Misc::(validateDDBytes) err: ['10240+0 records in', '10240+0 records out', '10737418240 bytes (11 GB) copied, 224.736 s, 47.8 MB/s'], size: 10737418240
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,838::volume::1111::Storage.Volume::(qemuConvert) (qemuConvert): COPY /rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/a250db32-9b39-4533-8bc6-926d4ae17535/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b to /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/images/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b DONE
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,848::volume::646::Storage.Volume::(setLegality) sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b legality = LEGAL 
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,856::image::778::Storage.Image::(copyCollapsed) Finished copying a250db32-9b39-4533-8bc6-926d4ae17535:228f2939-3615-4733-ae3c-fc37390a2d0b -> 464da998-ebd2-46a1-bab0-1c02a21a165e:228f2939-3615-4733-ae3c-fc37390a2d0b
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::INFO::2014-01-24 19:36:00,856::blockVolume::393::Storage.Volume::(teardown) Tearing down volume a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b justme False
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:00,857::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --autobackup n --available n a250db32-9b39-4533-8bc6-926d4ae17535/228f2939-3615-4733-ae3c-fc37390a2d0b' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:00,937::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:00,942::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,248::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,248::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,344::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>a251d5d0-0f19-4169-8c5d-8f519aa59fa4::DEBUG::2014-01-24 19:36:01,353::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Dummy-233::DEBUG::2014-01-24 19:36:01,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:01,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266248 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:02,945::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:02,951::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:03,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:03,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273961 s, 37.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:03,947::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:03,953::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000333656 s, 1.0 MB/s\n'; <rc> = 0
>Thread-789::INFO::2014-01-24 19:36:04,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-789::INFO::2014-01-24 19:36:04,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0479823', 'lastCheck': '3.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000333656', 'lastCheck': '0.4', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:36:04,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:04,959::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-791::DEBUG::2014-01-24 19:36:05,530::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-791::INFO::2014-01-24 19:36:05,530::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None)
>Thread-791::INFO::2014-01-24 19:36:05,530::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'a251d5d0-0f19-4169-8c5d-8f519aa59fa4': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'a251d5d0-0f19-4169-8c5d-8f519aa59fa4'}}}
>Thread-792::DEBUG::2014-01-24 19:36:05,604::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [1d54c437]
>Thread-792::INFO::2014-01-24 19:36:05,604::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None)
>Thread-792::INFO::2014-01-24 19:36:05,604::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b 
>Thread-792::DEBUG::2014-01-24 19:36:05,606::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-792::DEBUG::2014-01-24 19:36:05,612::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000888343 s, 576 kB/s\n'; <rc> = 0
>Thread-792::DEBUG::2014-01-24 19:36:05,613::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000888343 s, 576 kB/s'], size: 512
>Thread-792::DEBUG::2014-01-24 19:36:05,615::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-792::DEBUG::2014-01-24 19:36:05,620::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000537701 s, 952 kB/s\n'; <rc> = 0
>Thread-792::DEBUG::2014-01-24 19:36:05,621::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000537701 s, 952 kB/s'], size: 512
>Thread-792::INFO::2014-01-24 19:36:05,621::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-792::INFO::2014-01-24 19:36:05,621::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-793::DEBUG::2014-01-24 19:36:05,695::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-793::INFO::2014-01-24 19:36:05,696::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', vmList=[{'imglist': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>', 'vm': 'ae133201-adba-4434-a3f0-54e56eeaaa17'}], sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None)
>Thread-793::INFO::2014-01-24 19:36:05,697::sp::1273::Storage.StoragePool::(updateVM) spUUID=3ea3dad7-383a-417b-b9b7-63ce4660f638 sdUUID=464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-793::INFO::2014-01-24 19:36:05,698::sp::1284::Storage.StoragePool::(updateVM) vmUUID=ae133201-adba-4434-a3f0-54e56eeaaa17 imgList=['df30ebf7-0d71-40b0-a33e-07170bdead7d']
>Thread-793::INFO::2014-01-24 19:36:05,701::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None
>Thread-794::DEBUG::2014-01-24 19:36:05,781::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-794::INFO::2014-01-24 19:36:05,781::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='a251d5d0-0f19-4169-8c5d-8f519aa59fa4', spUUID=None, options=None)
>Thread-794::INFO::2014-01-24 19:36:05,782::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None
>Dummy-233::DEBUG::2014-01-24 19:36:05,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:05,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273863 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:06,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:06,967::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-796::DEBUG::2014-01-24 19:36:07,864::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-796::INFO::2014-01-24 19:36:07,865::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-796::INFO::2014-01-24 19:36:07,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-797::DEBUG::2014-01-24 19:36:07,870::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-797::INFO::2014-01-24 19:36:07,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-797::INFO::2014-01-24 19:36:07,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606604800', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:36:07,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:08,000::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263604 s, 38.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:08,970::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:08,975::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:10,009::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:10,062::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272662 s, 37.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:10,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:10,769::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000533941 s, 7.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:10,978::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:10,983::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:12,071::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:12,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247516 s, 41.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:12,986::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:12,991::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:13,960::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:13,966::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000298866 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:14,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:14,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272561 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:14,994::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:14,999::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:16,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:16,245::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276086 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:17,002::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:17,007::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-801::DEBUG::2014-01-24 19:36:17,912::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-801::INFO::2014-01-24 19:36:17,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-801::INFO::2014-01-24 19:36:17,913::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-802::DEBUG::2014-01-24 19:36:17,937::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-802::INFO::2014-01-24 19:36:17,938::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-802::INFO::2014-01-24 19:36:17,939::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:36:18,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:18,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246665 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:19,010::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:19,015::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-803::INFO::2014-01-24 19:36:19,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-803::INFO::2014-01-24 19:36:19,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000533941', 'lastCheck': '8.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000298866', 'lastCheck': '5.5', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:36:20,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:20,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243544 s, 42.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:20,772::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-120::DEBUG::2014-01-24 19:36:20,772::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:36:20,775::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:20,780::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00053094 s, 3.9 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:20,780::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00053094 s, 3.9 MB/s'], size: 2048
>Thread-120::DEBUG::2014-01-24 19:36:20,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-120::DEBUG::2014-01-24 19:36:20,781::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:36:20,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:21,018::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:21,024::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:22,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:22,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273598 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:23,027::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:23,032::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:23,972::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:23,978::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000357882 s, 956 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:24,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:24,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274671 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:25,035::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:25,040::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:26,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:26,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241761 s, 42.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:27,043::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:27,048::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-807::DEBUG::2014-01-24 19:36:28,002::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-807::INFO::2014-01-24 19:36:28,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Dummy-233::DEBUG::2014-01-24 19:36:28,555::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:28,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0263494 s, 38.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:29,051::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:29,056::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:29,446::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:29,447::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6']
>Thread-120::INFO::2014-01-24 19:36:29,447::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-120::INFO::2014-01-24 19:36:29,447::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-120::INFO::2014-01-24 19:36:29,447::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-807::INFO::2014-01-24 19:36:29,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-120::DEBUG::2014-01-24 19:36:29,450::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-809::DEBUG::2014-01-24 19:36:29,461::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-809::INFO::2014-01-24 19:36:29,462::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-809::INFO::2014-01-24 19:36:29,463::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-120::DEBUG::2014-01-24 19:36:29,555::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:29,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:29,563::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000515568 s, 7.9 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:30,616::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:30,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275311 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:31,059::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:31,064::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:32,678::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:32,729::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249535 s, 41.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:33,067::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:33,072::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:33,985::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:33,991::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000339503 s, 1.0 MB/s\n'; <rc> = 0
>Thread-811::INFO::2014-01-24 19:36:34,666::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-811::INFO::2014-01-24 19:36:34,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000515568', 'lastCheck': '5.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000339503', 'lastCheck': '0.7', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:36:34,738::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:34,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272172 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:35,075::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:35,080::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:36,800::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:36,850::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024505 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:37,083::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:37,088::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:38,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:38,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02438 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:39,091::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:39,096::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-814::DEBUG::2014-01-24 19:36:39,543::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [e019bb8]
>Thread-814::INFO::2014-01-24 19:36:39,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-814::INFO::2014-01-24 19:36:39,544::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-815::DEBUG::2014-01-24 19:36:39,549::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [e019bb8]
>Thread-815::INFO::2014-01-24 19:36:39,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-815::INFO::2014-01-24 19:36:39,552::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-120::DEBUG::2014-01-24 19:36:39,582::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:39,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000532419 s, 7.7 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:40,918::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:40,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273431 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:41,099::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:41,105::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-817::DEBUG::2014-01-24 19:36:41,465::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-817::INFO::2014-01-24 19:36:41,466::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-817::INFO::2014-01-24 19:36:41,468::sd::582::Storage.StorageDomain::(getVMsList) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17']
>Thread-817::INFO::2014-01-24 19:36:41,468::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17']
>Thread-817::INFO::2014-01-24 19:36:41,469::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'ae133201-adba-4434-a3f0-54e56eeaaa17': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>'}}
>Dummy-233::DEBUG::2014-01-24 19:36:42,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:43,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245187 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:43,107::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:43,113::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:43,998::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:44,004::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365791 s, 935 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:45,039::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:45,088::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244978 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:45,116::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:45,121::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-819::DEBUG::2014-01-24 19:36:46,380::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7fbb509f]
>Thread-819::INFO::2014-01-24 19:36:46,380::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None)
>Thread-819::DEBUG::2014-01-24 19:36:46,381::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-819::DEBUG::2014-01-24 19:36:46,476::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-819::DEBUG::2014-01-24 19:36:46,480::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-819::INFO::2014-01-24 19:36:46,480::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b 
>Thread-819::DEBUG::2014-01-24 19:36:46,482::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-819::DEBUG::2014-01-24 19:36:46,488::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000526967 s, 972 kB/s\n'; <rc> = 0
>Thread-819::DEBUG::2014-01-24 19:36:46,488::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000526967 s, 972 kB/s'], size: 512
>Thread-819::DEBUG::2014-01-24 19:36:46,491::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-819::DEBUG::2014-01-24 19:36:46,496::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000527023 s, 971 kB/s\n'; <rc> = 0
>Thread-819::DEBUG::2014-01-24 19:36:46,496::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000527023 s, 971 kB/s'], size: 512
>Thread-819::INFO::2014-01-24 19:36:46,496::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-819::INFO::2014-01-24 19:36:46,497::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-820::DEBUG::2014-01-24 19:36:46,506::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [7fbb509f]
>Thread-820::INFO::2014-01-24 19:36:46,506::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None)
>Thread-820::INFO::2014-01-24 19:36:46,508::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': ['df30ebf7-0d71-40b0-a33e-07170bdead7d']}
>Dummy-233::DEBUG::2014-01-24 19:36:47,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:47,124::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:47,134::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:47,171::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481113 s, 21.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:49,146::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:49,151::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:49,180::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:49,232::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262636 s, 39.0 MB/s\n'; <rc> = 0
>Thread-822::DEBUG::2014-01-24 19:36:49,598::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-822::INFO::2014-01-24 19:36:49,598::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-822::INFO::2014-01-24 19:36:49,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-120::DEBUG::2014-01-24 19:36:49,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-823::DEBUG::2014-01-24 19:36:49,624::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-823::INFO::2014-01-24 19:36:49,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-823::INFO::2014-01-24 19:36:49,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-120::DEBUG::2014-01-24 19:36:49,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000560232 s, 7.3 MB/s\n'; <rc> = 0
>Thread-824::INFO::2014-01-24 19:36:49,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-824::INFO::2014-01-24 19:36:49,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000560232', 'lastCheck': '0.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365791', 'lastCheck': '5.8', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:36:51,154::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:51,159::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:51,241::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:51,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271925 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:53,162::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:53,167::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:53,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:53,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269886 s, 37.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:36:54,012::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:36:54,017::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360746 s, 948 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:55,170::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:55,175::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:55,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:55,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274341 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:57,178::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:57,184::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:57,427::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:57,479::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027556 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:36:59,186::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:36:59,192::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:36:59,489::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:36:59,538::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241541 s, 42.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:36:59,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:36:59,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580114 s, 7.1 MB/s\n'; <rc> = 0
>Thread-829::DEBUG::2014-01-24 19:36:59,684::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-829::INFO::2014-01-24 19:36:59,686::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-829::INFO::2014-01-24 19:36:59,687::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-830::DEBUG::2014-01-24 19:36:59,696::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-830::INFO::2014-01-24 19:36:59,698::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-830::INFO::2014-01-24 19:36:59,706::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:37:01,195::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:01,200::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:01,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:01,600::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270262 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:03,203::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:03,208::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:03,609::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:03,661::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272518 s, 37.6 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:04,025::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:04,031::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000363962 s, 940 kB/s\n'; <rc> = 0
>Thread-832::INFO::2014-01-24 19:37:04,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-832::INFO::2014-01-24 19:37:04,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580114', 'lastCheck': '5.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000363962', 'lastCheck': '0.9', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:37:05,211::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:05,216::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:05,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:05,721::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248569 s, 41.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:07,219::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:07,224::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:07,730::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:07,782::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264596 s, 38.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:09,227::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:09,232::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:09,670::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:09,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00060092 s, 6.8 MB/s\n'; <rc> = 0
>Thread-835::DEBUG::2014-01-24 19:37:09,761::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-835::INFO::2014-01-24 19:37:09,761::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-835::INFO::2014-01-24 19:37:09,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-836::DEBUG::2014-01-24 19:37:09,767::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-836::INFO::2014-01-24 19:37:09,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-836::INFO::2014-01-24 19:37:09,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:37:09,791::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:09,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265933 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:11,235::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:11,240::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:11,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:11,902::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243976 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:13,243::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:13,248::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:13,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:13,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276857 s, 37.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:14,038::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:14,044::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000389498 s, 878 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:15,251::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:15,256::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:15,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:16,026::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274438 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:17,259::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:17,266::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:18,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:18,085::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245983 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:19,271::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:19,276::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:19,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:19,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558672 s, 7.3 MB/s\n'; <rc> = 0
>Thread-840::DEBUG::2014-01-24 19:37:19,809::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-840::INFO::2014-01-24 19:37:19,809::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-840::INFO::2014-01-24 19:37:19,810::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-841::DEBUG::2014-01-24 19:37:19,815::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-841::INFO::2014-01-24 19:37:19,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-841::INFO::2014-01-24 19:37:19,816::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-842::INFO::2014-01-24 19:37:20,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-842::INFO::2014-01-24 19:37:20,059::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558672', 'lastCheck': '0.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000389498', 'lastCheck': '6.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:37:20,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:20,151::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309829 s, 33.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:21,279::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:21,284::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:22,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:22,213::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276866 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:23,287::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:23,292::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:24,051::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:24,057::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000363833 s, 940 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:24,222::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:24,275::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271386 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:25,295::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:25,300::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:26,284::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:26,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284754 s, 36.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:27,303::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:27,308::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:28,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:28,400::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027065 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:29,311::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:29,316::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:29,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:29,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631127 s, 6.5 MB/s\n'; <rc> = 0
>Thread-847::DEBUG::2014-01-24 19:37:29,861::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-847::INFO::2014-01-24 19:37:29,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-847::INFO::2014-01-24 19:37:29,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-848::DEBUG::2014-01-24 19:37:29,869::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-848::INFO::2014-01-24 19:37:29,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-848::INFO::2014-01-24 19:37:29,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:37:30,409::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:30,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269839 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:31,319::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:31,324::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:32,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:32,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241785 s, 42.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:33,327::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:33,333::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:34,064::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:34,070::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000329612 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:34,531::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:34,584::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279484 s, 36.6 MB/s\n'; <rc> = 0
>Thread-850::INFO::2014-01-24 19:37:35,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-850::INFO::2014-01-24 19:37:35,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631127', 'lastCheck': '5.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000329612', 'lastCheck': '1.2', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:37:35,335::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:35,340::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:36,593::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:36,646::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272904 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:37,343::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:37,349::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:38,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:38,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024797 s, 41.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:39,351::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:39,357::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:39,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:39,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641443 s, 6.4 MB/s\n'; <rc> = 0
>Thread-853::DEBUG::2014-01-24 19:37:39,916::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-853::INFO::2014-01-24 19:37:39,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-853::INFO::2014-01-24 19:37:39,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-854::DEBUG::2014-01-24 19:37:39,926::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-854::INFO::2014-01-24 19:37:39,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-854::INFO::2014-01-24 19:37:39,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:37:40,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:40,768::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280626 s, 36.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:41,359::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:41,365::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:42,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:42,827::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244346 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:43,368::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:43,373::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:44,078::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:44,083::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349297 s, 979 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:44,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:44,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247335 s, 41.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:45,376::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:45,381::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:46,896::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:46,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274122 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:47,384::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:47,389::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:48,958::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:49,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243752 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:49,391::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:49,397::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:49,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:49,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664177 s, 6.2 MB/s\n'; <rc> = 0
>Thread-858::DEBUG::2014-01-24 19:37:50,003::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-858::INFO::2014-01-24 19:37:50,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-858::INFO::2014-01-24 19:37:50,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-859::DEBUG::2014-01-24 19:37:50,012::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-859::INFO::2014-01-24 19:37:50,012::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-859::INFO::2014-01-24 19:37:50,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-860::INFO::2014-01-24 19:37:50,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-860::INFO::2014-01-24 19:37:50,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000664177', 'lastCheck': '0.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349297', 'lastCheck': '6.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:37:51,017::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:51,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271907 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:51,400::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:51,405::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:53,078::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:53,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027326 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:53,408::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:53,413::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:37:54,090::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:37:54,096::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000346199 s, 988 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:55,140::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:55,193::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278249 s, 36.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:55,416::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:55,421::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:57,202::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:57,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242493 s, 42.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:57,424::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:57,429::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:37:59,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:37:59,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275319 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:37:59,432::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:37:59,437::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:37:59,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:37:59,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630704 s, 6.5 MB/s\n'; <rc> = 0
>Thread-865::DEBUG::2014-01-24 19:38:00,049::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-865::INFO::2014-01-24 19:38:00,049::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-865::INFO::2014-01-24 19:38:00,049::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-866::DEBUG::2014-01-24 19:38:00,055::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-866::INFO::2014-01-24 19:38:00,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-866::INFO::2014-01-24 19:38:00,056::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:38:01,324::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:01,376::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266148 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:01,440::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:01,445::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:03,386::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:03,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243367 s, 42.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:03,448::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:03,453::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:04,104::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:04,110::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000381447 s, 897 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:05,444::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:05,456::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:05,468::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:05,523::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428542 s, 23.9 MB/s\n'; <rc> = 0
>Thread-868::INFO::2014-01-24 19:38:05,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-868::INFO::2014-01-24 19:38:05,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630704', 'lastCheck': '5.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000381447', 'lastCheck': '1.4', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:38:07,488::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:07,493::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:07,533::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:07,586::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272851 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:09,496::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:09,502::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:09,595::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:09,648::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027213 s, 37.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:09,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:09,743::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000543363 s, 7.5 MB/s\n'; <rc> = 0
>Thread-871::DEBUG::2014-01-24 19:38:10,102::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-871::INFO::2014-01-24 19:38:10,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-871::INFO::2014-01-24 19:38:10,103::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-872::DEBUG::2014-01-24 19:38:10,109::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-872::INFO::2014-01-24 19:38:10,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-872::INFO::2014-01-24 19:38:10,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:38:11,505::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:11,510::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:11,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:11,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270986 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:13,513::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:13,518::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:13,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:13,772::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281688 s, 36.4 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:14,118::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:14,124::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00035141 s, 973 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:15,521::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:15,526::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:15,781::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:15,834::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275598 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:17,529::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:17,534::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:17,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:17,895::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269156 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:19,537::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:19,542::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:19,753::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:19,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605798 s, 6.8 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:19,904::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:19,957::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272006 s, 37.6 MB/s\n'; <rc> = 0
>Thread-876::DEBUG::2014-01-24 19:38:20,186::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-876::INFO::2014-01-24 19:38:20,187::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-876::INFO::2014-01-24 19:38:20,187::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-877::DEBUG::2014-01-24 19:38:20,193::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-877::INFO::2014-01-24 19:38:20,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-877::INFO::2014-01-24 19:38:20,194::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-878::INFO::2014-01-24 19:38:20,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-878::INFO::2014-01-24 19:38:20,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000605798', 'lastCheck': '1.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00035141', 'lastCheck': '6.7', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:38:21,545::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:21,550::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:21,966::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:22,018::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268826 s, 38.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:23,553::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:23,558::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:24,028::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:24,080::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274673 s, 37.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:24,132::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:24,138::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349118 s, 980 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:25,561::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:25,566::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:26,090::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:26,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273312 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:27,569::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:27,574::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:28,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:28,244::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0278026 s, 36.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:29,577::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:29,582::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:29,764::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:29,770::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070243 s, 5.8 MB/s\n'; <rc> = 0
>Thread-883::DEBUG::2014-01-24 19:38:30,235::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-883::INFO::2014-01-24 19:38:30,235::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-883::INFO::2014-01-24 19:38:30,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-884::DEBUG::2014-01-24 19:38:30,242::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-884::INFO::2014-01-24 19:38:30,243::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-884::INFO::2014-01-24 19:38:30,244::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:38:30,253::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:30,306::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027199 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:31,585::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:31,590::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:32,315::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:32,368::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268551 s, 38.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:33,593::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:33,598::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:34,145::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:34,151::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000316974 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:34,377::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:34,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276098 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:35,601::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:35,606::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-886::INFO::2014-01-24 19:38:36,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-886::INFO::2014-01-24 19:38:36,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070243', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000316974', 'lastCheck': '1.9', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:38:36,439::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:36,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274134 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:37,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:37,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:38,501::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:38,551::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241171 s, 42.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:39,617::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:39,622::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:39,775::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:39,781::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000492875 s, 8.3 MB/s\n'; <rc> = 0
>Thread-889::DEBUG::2014-01-24 19:38:40,296::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-889::INFO::2014-01-24 19:38:40,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-889::INFO::2014-01-24 19:38:40,297::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-890::DEBUG::2014-01-24 19:38:40,315::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-890::INFO::2014-01-24 19:38:40,315::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-890::INFO::2014-01-24 19:38:40,316::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:38:40,560::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:40,613::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273376 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:41,625::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:41,630::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:42,622::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:42,675::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275964 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:43,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:43,639::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:44,159::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:44,164::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000328558 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:44,684::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:44,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244557 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:45,642::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:45,647::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:46,742::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:46,795::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267362 s, 38.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:47,650::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:47,655::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:48,804::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:48,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275357 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:49,658::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:49,663::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:49,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:49,791::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577176 s, 7.1 MB/s\n'; <rc> = 0
>Thread-894::DEBUG::2014-01-24 19:38:50,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-894::INFO::2014-01-24 19:38:50,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-894::INFO::2014-01-24 19:38:50,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-895::DEBUG::2014-01-24 19:38:50,360::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-895::INFO::2014-01-24 19:38:50,360::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-895::INFO::2014-01-24 19:38:50,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:38:50,866::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:50,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272425 s, 37.6 MB/s\n'; <rc> = 0
>Thread-896::INFO::2014-01-24 19:38:51,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-896::INFO::2014-01-24 19:38:51,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577176', 'lastCheck': '1.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000328558', 'lastCheck': '7.1', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:38:51,666::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:51,671::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:52,928::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:52,980::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026805 s, 38.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:53,674::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:53,679::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:38:54,171::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:38:54,177::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359739 s, 951 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:54,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:55,042::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272421 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:55,682::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:55,687::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:57,051::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:57,101::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245317 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:57,690::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:57,695::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:38:59,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:38:59,163::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272791 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:38:59,698::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:38:59,703::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:38:59,796::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:38:59,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660085 s, 6.2 MB/s\n'; <rc> = 0
>Thread-900::DEBUG::2014-01-24 19:39:00,404::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-900::INFO::2014-01-24 19:39:00,405::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-900::INFO::2014-01-24 19:39:00,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-902::DEBUG::2014-01-24 19:39:00,430::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-902::INFO::2014-01-24 19:39:00,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-902::INFO::2014-01-24 19:39:00,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:39:01,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:01,224::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272066 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:01,706::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:01,711::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:03,234::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:03,283::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243958 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:03,714::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:03,719::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:04,185::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:04,191::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000306043 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:05,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:05,347::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286934 s, 35.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:05,722::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:05,727::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-904::INFO::2014-01-24 19:39:06,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-904::INFO::2014-01-24 19:39:06,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660085', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306043', 'lastCheck': '2.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:39:07,356::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:07,408::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027208 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:07,730::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:07,735::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:09,418::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:09,468::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246578 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:09,738::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:09,743::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:09,807::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:09,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000609725 s, 6.7 MB/s\n'; <rc> = 0
>Thread-907::DEBUG::2014-01-24 19:39:10,499::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-907::INFO::2014-01-24 19:39:10,499::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-907::INFO::2014-01-24 19:39:10,499::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-908::DEBUG::2014-01-24 19:39:10,526::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-908::INFO::2014-01-24 19:39:10,526::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-908::INFO::2014-01-24 19:39:10,527::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:39:11,477::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:11,527::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244842 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:11,746::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:11,751::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:13,536::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:13,589::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267265 s, 38.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:13,754::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:13,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:14,198::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:14,203::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325898 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:15,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:15,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241837 s, 42.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:15,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:15,770::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:17,657::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:17,707::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245063 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:17,774::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:17,779::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:19,716::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:19,770::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275957 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:19,782::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:19,787::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:19,818::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:19,824::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590926 s, 6.9 MB/s\n'; <rc> = 0
>Thread-912::DEBUG::2014-01-24 19:39:20,579::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-912::INFO::2014-01-24 19:39:20,580::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-912::INFO::2014-01-24 19:39:20,580::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-913::DEBUG::2014-01-24 19:39:20,585::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-913::INFO::2014-01-24 19:39:20,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-913::INFO::2014-01-24 19:39:20,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-914::INFO::2014-01-24 19:39:21,570::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-914::INFO::2014-01-24 19:39:21,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590926', 'lastCheck': '1.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000325898', 'lastCheck': '7.4', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:39:21,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:21,790::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:21,800::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:21,849::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445552 s, 23.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:23,813::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:23,818::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:23,859::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:23,911::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271866 s, 37.7 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:24,211::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:24,217::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000341368 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:25,821::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:25,826::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:25,920::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:25,972::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271592 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:27,829::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:27,834::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:27,982::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:28,034::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273592 s, 37.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:29,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:29,835::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634346 s, 6.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:29,837::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:29,849::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:30,043::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:30,226::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.137247 s, 7.5 MB/s\n'; <rc> = 0
>Thread-918::DEBUG::2014-01-24 19:39:30,626::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-918::INFO::2014-01-24 19:39:30,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-918::INFO::2014-01-24 19:39:30,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-919::DEBUG::2014-01-24 19:39:30,631::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-919::INFO::2014-01-24 19:39:30,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-919::INFO::2014-01-24 19:39:30,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:39:31,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:31,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:32,235::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:32,288::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270177 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:33,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:33,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:34,224::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:34,230::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365617 s, 935 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:34,297::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:34,349::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027297 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:35,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:35,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:36,358::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:36,411::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271713 s, 37.7 MB/s\n'; <rc> = 0
>Thread-922::INFO::2014-01-24 19:39:36,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-922::INFO::2014-01-24 19:39:36,744::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634346', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365617', 'lastCheck': '2.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:39:37,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:37,886::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:38,420::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:38,473::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275939 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:39,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:39,863::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070477 s, 5.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:39,889::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:39,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:40,482::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:40,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272676 s, 37.6 MB/s\n'; <rc> = 0
>Thread-925::DEBUG::2014-01-24 19:39:40,677::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-925::INFO::2014-01-24 19:39:40,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-925::INFO::2014-01-24 19:39:40,678::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-926::DEBUG::2014-01-24 19:39:40,684::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-926::INFO::2014-01-24 19:39:40,684::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-926::INFO::2014-01-24 19:39:40,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:39:41,897::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:41,902::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:42,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:42,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271432 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:43,905::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:43,910::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:44,238::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:44,244::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000385842 s, 886 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:44,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:44,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239729 s, 42.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:45,913::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:45,918::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:46,664::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:46,717::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274962 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:47,921::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:47,926::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:48,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:48,779::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027076 s, 37.8 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:49,869::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:49,875::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063001 s, 6.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:49,929::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:49,934::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-930::DEBUG::2014-01-24 19:39:50,765::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-930::INFO::2014-01-24 19:39:50,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-930::INFO::2014-01-24 19:39:50,765::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-931::DEBUG::2014-01-24 19:39:50,771::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-931::INFO::2014-01-24 19:39:50,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-931::INFO::2014-01-24 19:39:50,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:39:50,788::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:50,838::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242643 s, 42.2 MB/s\n'; <rc> = 0
>Thread-932::INFO::2014-01-24 19:39:51,871::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-932::INFO::2014-01-24 19:39:51,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063001', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385842', 'lastCheck': '7.6', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:39:51,937::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:51,942::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:52,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:52,900::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270151 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:53,945::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:53,950::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:39:54,251::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:39:54,257::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000344865 s, 992 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:54,909::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:54,962::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027491 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:55,953::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:55,958::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:56,971::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:57,021::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244559 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:57,961::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:57,966::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:39:59,030::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:39:59,083::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273744 s, 37.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:39:59,880::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:39:59,886::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629782 s, 6.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:39:59,969::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:39:59,974::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-936::DEBUG::2014-01-24 19:40:00,856::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-936::INFO::2014-01-24 19:40:00,856::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-936::INFO::2014-01-24 19:40:00,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-937::DEBUG::2014-01-24 19:40:00,862::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-937::INFO::2014-01-24 19:40:00,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-937::INFO::2014-01-24 19:40:00,863::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:40:01,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:01,145::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270715 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:01,977::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:01,986::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:03,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:03,205::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246184 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:03,991::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:03,996::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:04,265::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:04,270::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000383929 s, 891 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:05,215::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:05,267::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274919 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:05,999::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:06,004::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-940::INFO::2014-01-24 19:40:07,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-940::INFO::2014-01-24 19:40:07,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629782', 'lastCheck': '7.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000383929', 'lastCheck': '2.8', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:40:07,277::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:07,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272274 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:08,007::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:08,012::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:09,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:09,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246792 s, 41.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:09,891::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:09,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000638803 s, 6.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:10,015::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:10,020::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-943::DEBUG::2014-01-24 19:40:10,968::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-943::INFO::2014-01-24 19:40:10,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-943::INFO::2014-01-24 19:40:10,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-944::DEBUG::2014-01-24 19:40:11,013::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-944::INFO::2014-01-24 19:40:11,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-944::INFO::2014-01-24 19:40:11,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:40:11,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:11,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02749 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:12,023::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:12,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:13,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:13,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027465 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:14,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:14,036::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:14,278::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:14,284::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000330447 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:15,522::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:15,572::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246125 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:16,039::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:16,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:17,581::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:17,631::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246708 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:18,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:18,052::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:19,640::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:19,693::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027521 s, 37.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:19,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:19,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603117 s, 6.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:20,054::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:20,059::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-948::DEBUG::2014-01-24 19:40:21,133::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-948::INFO::2014-01-24 19:40:21,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-948::INFO::2014-01-24 19:40:21,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-949::DEBUG::2014-01-24 19:40:21,139::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-949::INFO::2014-01-24 19:40:21,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-949::INFO::2014-01-24 19:40:21,140::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:40:21,702::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:21,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271565 s, 37.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:22,062::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:22,067::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-950::INFO::2014-01-24 19:40:22,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-950::INFO::2014-01-24 19:40:22,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000603117', 'lastCheck': '2.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000330447', 'lastCheck': '7.9', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:40:23,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:23,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245836 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:24,070::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:24,075::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:24,291::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:24,297::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000364508 s, 938 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:25,824::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:25,877::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275932 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:26,078::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:26,084::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:27,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:27,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251263 s, 40.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:28,087::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:28,092::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:29,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:29,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655046 s, 6.3 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:29,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:29,997::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273382 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:30,095::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:30,100::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-954::DEBUG::2014-01-24 19:40:31,215::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-954::INFO::2014-01-24 19:40:31,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-954::INFO::2014-01-24 19:40:31,216::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-955::DEBUG::2014-01-24 19:40:31,260::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-955::INFO::2014-01-24 19:40:31,260::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-955::INFO::2014-01-24 19:40:31,262::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:40:32,006::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:32,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027612 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:32,103::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:32,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:34,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:34,111::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:34,122::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:34,138::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244125 s, 41.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:34,304::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:34,310::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000350332 s, 976 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:36,132::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:36,137::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:36,147::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:36,199::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271121 s, 37.8 MB/s\n'; <rc> = 0
>Thread-958::INFO::2014-01-24 19:40:37,384::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-958::INFO::2014-01-24 19:40:37,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000655046', 'lastCheck': '7.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000350332', 'lastCheck': '3.1', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:40:38,141::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:38,146::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:38,208::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:38,261::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027305 s, 37.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:39,924::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:39,930::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000583751 s, 7.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:40,149::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:40,154::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:40,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:40,322::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275515 s, 37.2 MB/s\n'; <rc> = 0
>Thread-961::DEBUG::2014-01-24 19:40:41,354::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-961::INFO::2014-01-24 19:40:41,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-961::INFO::2014-01-24 19:40:41,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-962::DEBUG::2014-01-24 19:40:41,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-962::INFO::2014-01-24 19:40:41,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-962::INFO::2014-01-24 19:40:41,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:40:42,156::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:42,161::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:42,331::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:42,384::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275731 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:44,164::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:44,169::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:44,311::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:40:44,315::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e
>Thread-363::DEBUG::2014-01-24 19:40:44,316::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend
>Thread-363::DEBUG::2014-01-24 19:40:44,320::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'REMOTE_PATH=10.34.63.199:/cmg01', 'ROLE=Regular', 'SDUUID=464da998-ebd2-46a1-bab0-1c02a21a165e', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=ce59f9594adfadc40433a365f214d7e24f84cbcc']
>Thread-363::DEBUG::2014-01-24 19:40:44,321::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images []
>Thread-363::INFO::2014-01-24 19:40:44,321::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_imageNS already registered
>Thread-363::INFO::2014-01-24 19:40:44,322::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 464da998-ebd2-46a1-bab0-1c02a21a165e_volumeNS already registered
>Thread-363::DEBUG::2014-01-24 19:40:44,328::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:44,334::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359536 s, 951 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:44,393::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:44,446::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027408 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:46,172::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:46,177::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:46,455::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:46,508::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273454 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:48,180::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:48,185::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:48,517::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:48,570::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275773 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:49,936::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:49,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622773 s, 6.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:50,188::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:50,193::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:50,579::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:50,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243134 s, 42.1 MB/s\n'; <rc> = 0
>Thread-967::DEBUG::2014-01-24 19:40:51,486::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-967::INFO::2014-01-24 19:40:51,487::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-967::INFO::2014-01-24 19:40:51,487::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-968::DEBUG::2014-01-24 19:40:51,492::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-968::INFO::2014-01-24 19:40:51,492::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-968::INFO::2014-01-24 19:40:51,494::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:40:52,196::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:52,201::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-969::INFO::2014-01-24 19:40:52,560::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-969::INFO::2014-01-24 19:40:52,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622773', 'lastCheck': '2.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359536', 'lastCheck': '8.2', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:40:52,638::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:52,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274633 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:54,204::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:54,209::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:40:54,341::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:40:54,347::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000325108 s, 1.1 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:54,700::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:54,753::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272861 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:56,212::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:56,217::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:56,762::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:56,812::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245861 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:40:58,220::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:40:58,225::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:40:58,821::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:40:58,873::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274494 s, 37.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:40:59,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:40:59,953::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641755 s, 6.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:00,228::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:00,233::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:00,883::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:00,935::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276723 s, 37.0 MB/s\n'; <rc> = 0
>Thread-973::DEBUG::2014-01-24 19:41:01,539::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-973::INFO::2014-01-24 19:41:01,539::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-973::INFO::2014-01-24 19:41:01,540::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-974::DEBUG::2014-01-24 19:41:01,545::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-974::INFO::2014-01-24 19:41:01,545::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-974::INFO::2014-01-24 19:41:01,546::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:41:02,236::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:02,241::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:02,945::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:02,995::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246942 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:04,244::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:04,249::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:41:04,354::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:04,360::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349686 s, 978 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:05,004::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:05,056::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272341 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:06,252::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:06,257::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:07,065::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:07,118::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272264 s, 37.6 MB/s\n'; <rc> = 0
>Thread-977::INFO::2014-01-24 19:41:07,689::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-977::INFO::2014-01-24 19:41:07,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641755', 'lastCheck': '7.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000349686', 'lastCheck': '3.3', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:41:08,260::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:08,265::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:09,127::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:09,177::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246261 s, 41.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:09,958::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:41:09,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622794 s, 6.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:10,268::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:10,273::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:11,186::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:11,239::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273657 s, 37.4 MB/s\n'; <rc> = 0
>Thread-980::DEBUG::2014-01-24 19:41:11,593::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-980::INFO::2014-01-24 19:41:11,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-980::INFO::2014-01-24 19:41:11,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-981::DEBUG::2014-01-24 19:41:11,598::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-981::INFO::2014-01-24 19:41:11,598::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-981::INFO::2014-01-24 19:41:11,599::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:41:12,276::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:12,281::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:13,248::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:13,300::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275421 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:14,284::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:14,289::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:41:14,367::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:14,373::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000403669 s, 847 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:15,310::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:15,359::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246709 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:16,292::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:16,297::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:17,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:17,421::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273387 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:18,300::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:18,305::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:19,430::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:19,483::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027182 s, 37.7 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:19,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:41:19,975::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649727 s, 6.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:20,308::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:20,313::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:21,492::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:21,545::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273221 s, 37.5 MB/s\n'; <rc> = 0
>Thread-985::DEBUG::2014-01-24 19:41:21,637::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-985::INFO::2014-01-24 19:41:21,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-985::INFO::2014-01-24 19:41:21,638::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-986::DEBUG::2014-01-24 19:41:21,644::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-986::INFO::2014-01-24 19:41:21,644::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-986::INFO::2014-01-24 19:41:21,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:41:22,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:22,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-987::INFO::2014-01-24 19:41:22,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-987::INFO::2014-01-24 19:41:22,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649727', 'lastCheck': '2.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000403669', 'lastCheck': '8.5', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:41:23,554::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:23,606::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269149 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:24,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:24,329::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:41:24,380::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:24,386::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000355317 s, 963 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:25,614::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:25,667::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274114 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:26,332::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:26,337::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:27,676::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:27,726::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245101 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:28,340::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:28,345::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:29,735::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:29,785::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024117 s, 42.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:29,978::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain a250db32-9b39-4533-8bc6-926d4ae17535
>Thread-120::DEBUG::2014-01-24 19:41:29,979::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:41:29,981::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:41:29,986::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000611524 s, 3.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:29,987::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000611524 s, 3.3 MB/s'], size: 2048
>Thread-120::DEBUG::2014-01-24 19:41:29,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=['_SHA_CKSUM=da39a3ee5e6b4b0d3255bfef95601890afd80709']
>Thread-120::DEBUG::2014-01-24 19:41:29,987::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-120::DEBUG::2014-01-24 19:41:29,988::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|/dev/mapper/1cmg02|/dev/mapper/3514f0c54d5c01d2d|/dev/mapper/3514f0c54d5c01d5f|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:30,348::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:30,360::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-991::DEBUG::2014-01-24 19:41:31,775::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-991::INFO::2014-01-24 19:41:31,775::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Dummy-233::DEBUG::2014-01-24 19:41:31,794::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:31,847::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273601 s, 37.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:32,288::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:32,289::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['VGUUID=0mtWjC-SFCz-UWlb-I5Ig-o41t-wssW-BfdACo', 'SDUUID=a250db32-9b39-4533-8bc6-926d4ae17535', 'ROLE=Master', u'PV0=pv:1cmg01,uuid:MyfdLz-2U1C-MY4K-ZLSy-Dksj-pF6s-XU6G30,pestart:0,pecount:677,mapoffset:0', 'LOCKPOLICY=', 'IOOPTIMEOUTSEC=10', 'CLASS=Data', 'DESCRIPTION=iscsi_0', 'LEASETIMESEC=60', 'MASTER_VERSION=1', 'LOCKRENEWALINTERVALSEC=5', 'POOL_DESCRIPTION=datacenter_iscsiTestStorage', 'POOL_SPM_ID=1', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'PHYBLKSIZE=512', 'POOL_SPM_LVER=0', 'POOL_UUID=3ea3dad7-383a-417b-b9b7-63ce4660f638', 'VERSION=3', u'POOL_DOMAINS=a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', '_SHA_CKSUM=c46ab2bcbcd4f15ba5bb0a975f8eece6d3414bf6']
>Thread-120::INFO::2014-01-24 19:41:32,290::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_imageNS already registered
>Thread-120::INFO::2014-01-24 19:41:32,290::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_volumeNS already registered
>Thread-120::INFO::2014-01-24 19:41:32,290::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace a250db32-9b39-4533-8bc6-926d4ae17535_lvmActivationNS already registered
>Thread-991::INFO::2014-01-24 19:41:32,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-120::DEBUG::2014-01-24 19:41:32,292::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-993::DEBUG::2014-01-24 19:41:32,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-993::INFO::2014-01-24 19:41:32,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-993::INFO::2014-01-24 19:41:32,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:41:32,363::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:32,369::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:32,393::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:32,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:41:32,402::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000688153 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:33,856::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:33,906::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244342 s, 41.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:34,373::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:34,378::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:41:34,393::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:34,399::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000326777 s, 1.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:35,915::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:35,965::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244015 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:36,381::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:36,387::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:37,974::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:38,027::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274226 s, 37.3 MB/s\n'; <rc> = 0
>Thread-995::INFO::2014-01-24 19:41:38,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-995::INFO::2014-01-24 19:41:38,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000688153', 'lastCheck': '5.7', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000326777', 'lastCheck': '3.7', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:41:38,389::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:38,395::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:40,036::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:40,086::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0242862 s, 42.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:40,397::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:40,403::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:42,095::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:42,146::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248994 s, 41.1 MB/s\n'; <rc> = 0
>Thread-998::DEBUG::2014-01-24 19:41:42,355::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-998::INFO::2014-01-24 19:41:42,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-998::INFO::2014-01-24 19:41:42,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-999::DEBUG::2014-01-24 19:41:42,361::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-999::INFO::2014-01-24 19:41:42,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-999::INFO::2014-01-24 19:41:42,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:41:42,406::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:42,418::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:42,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:41:42,438::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568881 s, 7.2 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:44,155::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:44,207::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268358 s, 38.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:41:44,407::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:44,413::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000366322 s, 934 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:44,438::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:44,443::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:46,216::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:46,270::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274653 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:46,446::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:46,451::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:48,279::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:48,329::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248183 s, 41.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:48,454::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:48,459::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:50,338::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:50,391::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277097 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:50,462::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:50,467::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:52,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-1003::DEBUG::2014-01-24 19:41:52,425::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1003::INFO::2014-01-24 19:41:52,427::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1003::INFO::2014-01-24 19:41:52,428::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1004::DEBUG::2014-01-24 19:41:52,437::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1004::INFO::2014-01-24 19:41:52,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1004::INFO::2014-01-24 19:41:52,448::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-120::DEBUG::2014-01-24 19:41:52,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:52,470::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:52,486::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:41:52,490::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558263 s, 7.3 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:52,535::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.109037 s, 9.4 MB/s\n'; <rc> = 0
>Thread-1005::INFO::2014-01-24 19:41:53,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1005::INFO::2014-01-24 19:41:53,318::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000558263', 'lastCheck': '0.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000366322', 'lastCheck': '8.9', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:41:54,419::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:41:54,425::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000347995 s, 983 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:54,507::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:54,512::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:54,544::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:54,597::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280212 s, 36.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:56,515::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:56,520::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:56,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:56,655::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271249 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:41:58,523::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:41:58,528::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:41:58,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:41:58,714::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276093 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:00,531::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:00,536::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:00,724::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:00,777::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276651 s, 37.0 MB/s\n'; <rc> = 0
>Thread-1010::DEBUG::2014-01-24 19:42:02,501::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1010::INFO::2014-01-24 19:42:02,501::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1010::INFO::2014-01-24 19:42:02,501::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1011::DEBUG::2014-01-24 19:42:02,510::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1011::INFO::2014-01-24 19:42:02,510::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1011::INFO::2014-01-24 19:42:02,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-120::DEBUG::2014-01-24 19:42:02,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:02,522::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588175 s, 7.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:02,542::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:02,547::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:02,786::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:02,836::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024776 s, 41.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:42:04,433::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:04,439::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00034872 s, 981 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:04,550::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:04,555::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:04,845::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:04,898::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279124 s, 36.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:06,558::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:06,563::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:06,907::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:06,961::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280624 s, 36.5 MB/s\n'; <rc> = 0
>Thread-1013::INFO::2014-01-24 19:42:08,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1013::INFO::2014-01-24 19:42:08,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588175', 'lastCheck': '5.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00034872', 'lastCheck': '4.0', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:42:08,566::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:08,571::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:08,970::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:09,020::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245991 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:10,574::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:10,584::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:11,029::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:11,082::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275652 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:42:12,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:12,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623456 s, 6.6 MB/s\n'; <rc> = 0
>Thread-1016::DEBUG::2014-01-24 19:42:12,556::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1016::INFO::2014-01-24 19:42:12,556::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1016::INFO::2014-01-24 19:42:12,556::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1017::DEBUG::2014-01-24 19:42:12,562::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1017::INFO::2014-01-24 19:42:12,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1017::INFO::2014-01-24 19:42:12,563::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:42:12,594::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:12,599::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:13,091::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:13,144::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275288 s, 37.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:42:14,446::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:14,452::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000385124 s, 888 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:14,602::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:14,607::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:15,153::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:15,203::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247453 s, 41.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:16,609::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:16,614::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:17,212::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:17,265::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273066 s, 37.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:18,617::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:18,623::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:19,274::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:19,326::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273594 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:20,625::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:20,631::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:21,335::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:21,388::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269247 s, 38.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:42:22,538::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:22,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000627888 s, 6.5 MB/s\n'; <rc> = 0
>Thread-1021::DEBUG::2014-01-24 19:42:22,600::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1021::INFO::2014-01-24 19:42:22,600::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1021::INFO::2014-01-24 19:42:22,600::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1022::DEBUG::2014-01-24 19:42:22,605::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1022::INFO::2014-01-24 19:42:22,606::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1022::INFO::2014-01-24 19:42:22,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-12::DEBUG::2014-01-24 19:42:22,633::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:22,638::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:23,397::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:23,450::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273384 s, 37.5 MB/s\n'; <rc> = 0
>Thread-1023::INFO::2014-01-24 19:42:23,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1023::INFO::2014-01-24 19:42:23,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000627888', 'lastCheck': '1.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385124', 'lastCheck': '9.2', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:42:24,459::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:24,464::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000371354 s, 921 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:24,641::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:24,646::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:25,459::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:25,512::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274461 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:26,649::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:26,654::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:27,521::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:27,571::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0246515 s, 41.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:28,657::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:28,662::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:29,580::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:29,633::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027684 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:30,665::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:30,670::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:31,643::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:31,696::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276718 s, 37.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:42:32,549::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:32,555::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588921 s, 7.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:32,673::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:32,678::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1027::DEBUG::2014-01-24 19:42:32,697::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1027::INFO::2014-01-24 19:42:32,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1027::INFO::2014-01-24 19:42:32,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1028::DEBUG::2014-01-24 19:42:32,725::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1028::INFO::2014-01-24 19:42:32,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1028::INFO::2014-01-24 19:42:32,727::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:42:33,705::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:33,755::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247712 s, 41.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:42:34,472::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:34,478::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.00033562 s, 1.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:34,681::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:34,686::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:35,764::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:35,814::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245045 s, 41.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:36,689::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:36,694::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:37,823::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:37,876::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027595 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:38,697::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:38,702::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1031::INFO::2014-01-24 19:42:38,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1031::INFO::2014-01-24 19:42:38,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000588921', 'lastCheck': '6.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00033562', 'lastCheck': '4.3', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:42:39,886::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:39,938::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276822 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:40,705::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:40,710::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:41,948::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:41,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244799 s, 41.8 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:42:42,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:42,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635942 s, 6.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:42,713::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:42,718::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1034::DEBUG::2014-01-24 19:42:42,783::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1034::INFO::2014-01-24 19:42:42,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1034::INFO::2014-01-24 19:42:42,784::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1035::DEBUG::2014-01-24 19:42:42,789::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1035::INFO::2014-01-24 19:42:42,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1035::INFO::2014-01-24 19:42:42,790::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:42:44,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:44,060::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274856 s, 37.3 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:42:44,486::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:44,492::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000372165 s, 919 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:44,721::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:44,726::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:46,069::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:46,122::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273912 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:46,729::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:46,734::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:48,131::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:48,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245938 s, 41.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:48,737::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:48,742::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:50,190::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:50,243::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027224 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:50,745::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:50,750::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:52,252::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:52,305::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272288 s, 37.6 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:42:52,572::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:42:52,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000562773 s, 7.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:52,753::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:52,759::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1039::DEBUG::2014-01-24 19:42:52,827::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1039::INFO::2014-01-24 19:42:52,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1039::INFO::2014-01-24 19:42:52,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1040::DEBUG::2014-01-24 19:42:52,833::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1040::INFO::2014-01-24 19:42:52,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1040::INFO::2014-01-24 19:42:52,834::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-1041::INFO::2014-01-24 19:42:53,867::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1041::INFO::2014-01-24 19:42:53,867::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000562773', 'lastCheck': '1.3', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372165', 'lastCheck': '9.4', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:42:54,314::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:54,364::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244598 s, 41.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:42:54,499::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:42:54,505::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360605 s, 948 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:54,762::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:54,766::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:56,373::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:56,426::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276026 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:56,769::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:56,774::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:42:58,435::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:42:58,488::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272508 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:42:58,777::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:42:58,783::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:00,497::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:00,547::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245411 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:00,786::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:00,791::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:02,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:02,597::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:02,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635807 s, 6.4 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:02,647::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653964 s, 15.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:02,793::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:02,799::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1045::DEBUG::2014-01-24 19:43:02,915::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1045::INFO::2014-01-24 19:43:02,916::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1045::INFO::2014-01-24 19:43:02,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1046::DEBUG::2014-01-24 19:43:02,921::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1046::INFO::2014-01-24 19:43:02,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1046::INFO::2014-01-24 19:43:02,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-363::DEBUG::2014-01-24 19:43:04,512::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:04,518::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000344368 s, 993 kB/s\n'; <rc> = 0
>Thread-1048::DEBUG::2014-01-24 19:43:04,635::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1048::INFO::2014-01-24 19:43:04,636::logUtils::44::dispatcher::(wrapper) Run and protect: getVmsInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', vmList=[], options=None)
>Thread-1048::INFO::2014-01-24 19:43:04,638::sd::582::Storage.StorageDomain::(getVMsList) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17']
>Thread-1048::INFO::2014-01-24 19:43:04,638::sd::599::Storage.StorageDomain::(getVMsInfo) vmList=['ae133201-adba-4434-a3f0-54e56eeaaa17']
>Thread-1048::INFO::2014-01-24 19:43:04,640::logUtils::47::dispatcher::(wrapper) Run and protect: getVmsInfo, Return response: {'vmlist': {'ae133201-adba-4434-a3f0-54e56eeaaa17': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:id="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10737418240" ovf:description=""/><Nic ovf:id="94563b14-27a9-4679-878a-ad168f0e1af3"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:size="10" ovf:actual_size="10" ovf:vm_snapshot_id="cc9cdd62-b5f7-46f4-8271-8363696b3ba7" ovf:parentRef="" ovf:fileRef="df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b" ovf:format="http://www.vmware.com/specifications/vmdk.html#sparse" ovf:volume-format="RAW" ovf:volume-type="Preallocated" ovf:disk-interface="VirtIO" ovf:boot="true" ovf:disk-alias="vm01_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><Domain></Domain><CreationDate>2014/01/24 18:25:52</CreationDate><ExportDate>2014/01/24 18:36:06</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>0</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>512</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>template_vm01</Name><TemplateId>ae133201-adba-4434-a3f0-54e56eeaaa17</TemplateId><Origin>3</Origin><default_display_type>1</default_display_type><IsDisabled>false</IsDisabled><TrustedService>false</TrustedService><TemplateType>TEMPLATE</TemplateType><Section ovf:id="ae133201-adba-4434-a3f0-54e56eeaaa17" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>vm01_Disk1</rasd:Caption><rasd:InstanceId>228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>a250db32-9b39-4533-8bc6-926d4ae17535</rasd:StorageId><rasd:StoragePoolId>3ea3dad7-383a-417b-b9b7-63ce4660f638</rasd:StoragePoolId><rasd:CreationDate>2014/01/24 18:26:01</rasd:CreationDate><rasd:LastModified>2014/01/24 18:26:06</rasd:LastModified><Type>disk</Type><Device>disk</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>Ethernet adapter on ovirtmgmt</rasd:Caption><rasd:InstanceId>94563b14-27a9-4679-878a-ad168f0e1af3</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>ovirtmgmt</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>ovirtmgmt</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:speed>1000</rasd:speed><Type>interface</Type><Device>bridge</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item><Item><rasd:Caption>Graphical Controller</rasd:Caption><rasd:InstanceId>ae0d76e4-612b-4199-bb4f-5cdcf644eba7</rasd:InstanceId><rasd:ResourceType>20</rasd:ResourceType><rasd:VirtualQuantity>1</rasd:VirtualQuantity><rasd:SinglePciQxl>false</rasd:SinglePciQxl><Type>video</Type><Device>qxl</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><vram>32768</vram><heads>1</heads></SpecParams></Item><Item><rasd:Caption>CDROM</rasd:Caption><rasd:InstanceId>98cce59b-be5a-4097-8674-6dc1c71adc63</rasd:InstanceId><rasd:ResourceType>15</rasd:ResourceType><Type>disk</Type><Device>cdrom</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><path></path></SpecParams></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>e14676d1-1916-42c2-bc07-8d99affd8103</rasd:InstanceId><Type>controller</Type><Device>virtio-scsi</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>false</IsReadOnly><Alias></Alias></Item><Item><rasd:ResourceType>0</rasd:ResourceType><rasd:InstanceId>10eb5bd6-0aa1-46c3-a2d0-dd113d1e999f</rasd:InstanceId><Type>balloon</Type><Device>memballoon</Device><rasd:Address></rasd:Address><BootOrder>0</BootOrder><IsPlugged>true</IsPlugged><IsReadOnly>true</IsReadOnly><Alias></Alias><SpecParams><model>virtio</model></SpecParams></Item></Section></Content></ovf:Envelope>'}}
>Dummy-233::DEBUG::2014-01-24 19:43:04,656::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:04,709::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276123 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:04,801::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:04,807::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:06,718::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:06,771::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270851 s, 37.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:06,809::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:06,814::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1050::DEBUG::2014-01-24 19:43:07,943::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [75bf74bf]
>Thread-1050::INFO::2014-01-24 19:43:07,944::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='a250db32-9b39-4533-8bc6-926d4ae17535', spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', imgUUID='df30ebf7-0d71-40b0-a33e-07170bdead7d', volUUID='228f2939-3615-4733-ae3c-fc37390a2d0b', options=None)
>Thread-1050::DEBUG::2014-01-24 19:43:07,945::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/1cmg01|\', \'r|.*|\' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1 }  backup {  retain_min = 50  retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags a250db32-9b39-4533-8bc6-926d4ae17535' (cwd None)
>Thread-1050::DEBUG::2014-01-24 19:43:08,038::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1050::DEBUG::2014-01-24 19:43:08,043::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded
>Thread-1050::INFO::2014-01-24 19:43:08,044::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=a250db32-9b39-4533-8bc6-926d4ae17535 imgUUID=df30ebf7-0d71-40b0-a33e-07170bdead7d volUUID = 228f2939-3615-4733-ae3c-fc37390a2d0b 
>Thread-1050::DEBUG::2014-01-24 19:43:08,046::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-1050::DEBUG::2014-01-24 19:43:08,051::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000566781 s, 903 kB/s\n'; <rc> = 0
>Thread-1050::DEBUG::2014-01-24 19:43:08,052::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000566781 s, 903 kB/s'], size: 512
>Thread-1050::DEBUG::2014-01-24 19:43:08,054::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata count=1' (cwd None)
>Thread-1050::DEBUG::2014-01-24 19:43:08,059::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000547561 s, 935 kB/s\n'; <rc> = 0
>Thread-1050::DEBUG::2014-01-24 19:43:08,060::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000547561 s, 935 kB/s'], size: 512
>Thread-1050::INFO::2014-01-24 19:43:08,060::volume::909::Storage.Volume::(getInfo) a250db32-9b39-4533-8bc6-926d4ae17535/df30ebf7-0d71-40b0-a33e-07170bdead7d/228f2939-3615-4733-ae3c-fc37390a2d0b info is {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}
>Thread-1050::INFO::2014-01-24 19:43:08,060::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'voltype': 'SHARED', 'description': 'Active VM', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'RAW', 'image': 'df30ebf7-0d71-40b0-a33e-07170bdead7d', 'ctime': '1390587961', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1390587966', 'apparentsize': '10737418240', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': '228f2939-3615-4733-ae3c-fc37390a2d0b', 'truesize': '10737418240', 'type': 'PREALLOCATED'}}
>Thread-1051::DEBUG::2014-01-24 19:43:08,111::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25] flowID [75bf74bf]
>Thread-1051::INFO::2014-01-24 19:43:08,111::logUtils::44::dispatcher::(wrapper) Run and protect: getImagesList(sdUUID='464da998-ebd2-46a1-bab0-1c02a21a165e', options=None)
>Thread-1051::INFO::2014-01-24 19:43:08,114::logUtils::47::dispatcher::(wrapper) Run and protect: getImagesList, Return response: {'imageslist': ['df30ebf7-0d71-40b0-a33e-07170bdead7d']}
>Dummy-233::DEBUG::2014-01-24 19:43:08,780::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:08,818::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:08,829::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:08,853::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241903 s, 42.3 MB/s\n'; <rc> = 0
>Thread-1052::INFO::2014-01-24 19:43:08,992::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1052::INFO::2014-01-24 19:43:08,992::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635807', 'lastCheck': '6.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000344368', 'lastCheck': '4.5', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:43:10,842::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:10,847::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:10,862::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:10,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027132 s, 37.7 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:43:12,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:12,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622275 s, 6.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:12,850::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:12,854::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:12,924::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-1055::DEBUG::2014-01-24 19:43:12,970::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1055::INFO::2014-01-24 19:43:12,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1055::INFO::2014-01-24 19:43:12,973::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1056::DEBUG::2014-01-24 19:43:12,982::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1056::INFO::2014-01-24 19:43:12,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1056::INFO::2014-01-24 19:43:12,990::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:43:12,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275382 s, 37.2 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:43:14,525::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:14,531::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000376059 s, 909 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:14,857::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:14,862::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:15,007::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:15,059::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269876 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:16,865::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:16,870::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:17,068::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:17,121::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275511 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:18,873::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:18,878::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:19,130::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:19,183::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273692 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:20,881::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:20,886::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:21,192::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:21,246::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02755 s, 37.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:43:22,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:22,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000635733 s, 6.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:22,889::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:22,894::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1060::DEBUG::2014-01-24 19:43:23,064::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1060::INFO::2014-01-24 19:43:23,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1060::INFO::2014-01-24 19:43:23,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1061::DEBUG::2014-01-24 19:43:23,070::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1061::INFO::2014-01-24 19:43:23,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1061::INFO::2014-01-24 19:43:23,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:43:23,255::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:23,308::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273806 s, 37.4 MB/s\n'; <rc> = 0
>Thread-1062::INFO::2014-01-24 19:43:24,111::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1062::INFO::2014-01-24 19:43:24,111::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635733', 'lastCheck': '1.5', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000376059', 'lastCheck': '9.6', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:43:24,538::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:24,543::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365822 s, 935 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:24,897::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:24,901::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:25,317::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:25,369::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273835 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:26,904::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:26,909::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:27,379::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:27,432::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275513 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:28,912::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:28,917::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:29,441::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:29,494::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276834 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:30,920::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:30,925::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:31,503::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:31,556::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274026 s, 37.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:43:32,647::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:32,653::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000525087 s, 7.8 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:32,928::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:32,933::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1066::DEBUG::2014-01-24 19:43:33,134::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1066::INFO::2014-01-24 19:43:33,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1066::INFO::2014-01-24 19:43:33,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1067::DEBUG::2014-01-24 19:43:33,140::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1067::INFO::2014-01-24 19:43:33,140::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1067::INFO::2014-01-24 19:43:33,141::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:43:33,568::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:33,620::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269017 s, 38.1 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:43:34,551::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:34,557::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000365346 s, 936 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:34,936::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:34,941::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:35,629::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:35,681::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270447 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:36,944::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:36,949::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:37,691::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:37,743::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272001 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:38,952::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:38,957::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1070::INFO::2014-01-24 19:43:39,296::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1070::INFO::2014-01-24 19:43:39,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000525087', 'lastCheck': '6.6', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000365346', 'lastCheck': '4.7', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:43:39,752::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:39,805::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265146 s, 38.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:40,960::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:40,965::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:41,815::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:41,865::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248992 s, 41.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:43:42,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:42,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000553592 s, 7.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:42,968::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:42,973::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1073::DEBUG::2014-01-24 19:43:43,177::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1073::INFO::2014-01-24 19:43:43,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1073::INFO::2014-01-24 19:43:43,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1074::DEBUG::2014-01-24 19:43:43,183::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1074::INFO::2014-01-24 19:43:43,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1074::INFO::2014-01-24 19:43:43,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:43:43,874::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:43,927::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273199 s, 37.5 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:43:44,565::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:44,571::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000355665 s, 962 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:44,976::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:44,981::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:45,936::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:45,989::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270519 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:46,984::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:46,989::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:47,998::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:48,048::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243846 s, 42.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:48,992::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:48,997::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:50,057::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:50,110::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275291 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:51,000::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:51,005::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:52,119::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:52,172::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273181 s, 37.5 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:43:52,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:43:52,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000578424 s, 7.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:53,008::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:53,013::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1078::DEBUG::2014-01-24 19:43:53,298::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1078::INFO::2014-01-24 19:43:53,298::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1078::INFO::2014-01-24 19:43:53,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1079::DEBUG::2014-01-24 19:43:53,304::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1079::INFO::2014-01-24 19:43:53,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1079::INFO::2014-01-24 19:43:53,305::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:43:54,181::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:54,231::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247022 s, 41.5 MB/s\n'; <rc> = 0
>Thread-1080::INFO::2014-01-24 19:43:54,453::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1080::INFO::2014-01-24 19:43:54,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000578424', 'lastCheck': '1.8', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000355665', 'lastCheck': '9.9', 'valid': True}}
>Thread-363::DEBUG::2014-01-24 19:43:54,578::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:43:54,584::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000360371 s, 949 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:55,015::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:55,020::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:56,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:56,293::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275308 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:57,023::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:57,028::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:43:58,302::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:43:58,355::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027713 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:43:59,031::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:43:59,036::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:00,365::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:00,413::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231807 s, 44.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:01,039::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:01,044::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:02,422::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:02,476::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276118 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:02,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:02,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571569 s, 7.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:03,047::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:03,052::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1084::DEBUG::2014-01-24 19:44:03,344::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1084::INFO::2014-01-24 19:44:03,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1084::INFO::2014-01-24 19:44:03,344::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1085::DEBUG::2014-01-24 19:44:03,350::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1085::INFO::2014-01-24 19:44:03,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1085::INFO::2014-01-24 19:44:03,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:44:04,485::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:04,537::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270505 s, 37.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:44:04,591::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:04,597::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000359467 s, 951 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:05,055::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:05,060::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:06,546::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:06,598::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261901 s, 39.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:07,062::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:07,067::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:08,607::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:08,660::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272598 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:09,070::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:09,075::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1088::INFO::2014-01-24 19:44:09,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1088::INFO::2014-01-24 19:44:09,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000571569', 'lastCheck': '6.9', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359467', 'lastCheck': '5.0', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:44:10,669::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:10,722::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275988 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:11,078::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:11,083::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:12,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:12,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629423 s, 6.5 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:12,731::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:12,784::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273527 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:13,086::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:13,091::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1091::DEBUG::2014-01-24 19:44:13,389::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1091::INFO::2014-01-24 19:44:13,389::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1091::INFO::2014-01-24 19:44:13,389::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1092::DEBUG::2014-01-24 19:44:13,402::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1092::INFO::2014-01-24 19:44:13,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1092::INFO::2014-01-24 19:44:13,403::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-363::DEBUG::2014-01-24 19:44:14,604::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:14,610::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000351556 s, 973 kB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:14,793::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:14,843::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247643 s, 41.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:15,094::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:15,099::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:16,852::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:16,905::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272196 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:17,102::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:17,108::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:18,914::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:18,964::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248144 s, 41.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:19,110::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:19,116::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:20,973::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:21,022::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232232 s, 44.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:21,118::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:21,123::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:22,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:22,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685818 s, 6.0 MB/s\n'; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:23,031::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:23,084::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276959 s, 37.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:23,126::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:23,131::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1096::DEBUG::2014-01-24 19:44:23,463::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1096::INFO::2014-01-24 19:44:23,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1096::INFO::2014-01-24 19:44:23,464::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1097::DEBUG::2014-01-24 19:44:23,469::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1097::INFO::2014-01-24 19:44:23,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1097::INFO::2014-01-24 19:44:23,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-363::DEBUG::2014-01-24 19:44:24,617::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:24,622::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000398081 s, 859 kB/s\n'; <rc> = 0
>Thread-1098::INFO::2014-01-24 19:44:24,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1098::INFO::2014-01-24 19:44:24,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685818', 'lastCheck': '2.0', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000398081', 'lastCheck': '0.1', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:44:25,093::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:25,135::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:25,145::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:25,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272052 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:27,158::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:27,163::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:27,178::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:27,230::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272552 s, 37.6 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:29,166::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:29,171::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:29,240::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:29,292::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273439 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:31,174::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:31,179::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:31,301::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:31,354::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274095 s, 37.4 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:32,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:32,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000499367 s, 8.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:33,182::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:33,187::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:33,363::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:33,416::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269825 s, 38.0 MB/s\n'; <rc> = 0
>Thread-1102::DEBUG::2014-01-24 19:44:33,529::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1102::INFO::2014-01-24 19:44:33,530::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1102::INFO::2014-01-24 19:44:33,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1103::DEBUG::2014-01-24 19:44:33,535::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1103::INFO::2014-01-24 19:44:33,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1103::INFO::2014-01-24 19:44:33,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Thread-363::DEBUG::2014-01-24 19:44:34,631::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:34,641::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000390616 s, 876 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:35,190::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:35,195::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:35,425::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:35,478::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273689 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:37,198::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:37,203::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:37,487::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:37,539::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269753 s, 38.0 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:39,206::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:39,211::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:39,548::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:39,602::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276493 s, 37.0 MB/s\n'; <rc> = 0
>Thread-1106::INFO::2014-01-24 19:44:39,847::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1106::INFO::2014-01-24 19:44:39,847::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000499367', 'lastCheck': '7.1', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000390616', 'lastCheck': '5.2', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:44:41,214::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:41,219::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:41,611::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:41,662::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261009 s, 39.2 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:42,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:42,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000472447 s, 8.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:43,222::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:43,226::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1109::DEBUG::2014-01-24 19:44:43,576::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1109::INFO::2014-01-24 19:44:43,576::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1109::INFO::2014-01-24 19:44:43,577::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1110::DEBUG::2014-01-24 19:44:43,582::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1110::INFO::2014-01-24 19:44:43,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1110::INFO::2014-01-24 19:44:43,583::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:44:43,671::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:43,725::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277316 s, 36.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:44:44,649::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:44,655::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000349621 s, 978 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:45,229::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:45,234::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:45,734::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:45,787::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.027612 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:47,237::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:47,242::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:47,796::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:47,848::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265737 s, 38.5 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:49,245::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:49,250::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:49,857::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:49,910::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273552 s, 37.4 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:51,253::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:51,258::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:51,919::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:51,976::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276324 s, 37.1 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:44:52,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:44:52,743::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594908 s, 6.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:53,261::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:53,266::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1114::DEBUG::2014-01-24 19:44:53,648::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1114::INFO::2014-01-24 19:44:53,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1114::INFO::2014-01-24 19:44:53,649::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1115::DEBUG::2014-01-24 19:44:53,685::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1115::INFO::2014-01-24 19:44:53,685::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1115::INFO::2014-01-24 19:44:53,686::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:44:53,986::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:54,035::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244062 s, 42.0 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:44:54,662::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:44:54,668::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000390191 s, 876 kB/s\n'; <rc> = 0
>Thread-1116::INFO::2014-01-24 19:44:54,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1116::INFO::2014-01-24 19:44:54,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594908', 'lastCheck': '2.2', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000390191', 'lastCheck': '0.3', 'valid': True}}
>Thread-12::DEBUG::2014-01-24 19:44:55,269::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:55,274::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:56,045::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:56,098::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275645 s, 37.1 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:57,277::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:57,282::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:44:58,107::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:44:58,160::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274322 s, 37.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:44:59,285::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:44:59,290::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:45:00,169::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:00,219::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025045 s, 40.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:01,293::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:01,298::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:45:02,228::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:02,280::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262581 s, 39.0 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:45:02,748::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:45:02,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00064699 s, 6.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:03,301::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:03,306::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1120::DEBUG::2014-01-24 19:45:03,751::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1120::INFO::2014-01-24 19:45:03,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1120::INFO::2014-01-24 19:45:03,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1121::DEBUG::2014-01-24 19:45:03,757::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1121::INFO::2014-01-24 19:45:03,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1121::INFO::2014-01-24 19:45:03,759::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}
>Dummy-233::DEBUG::2014-01-24 19:45:04,289::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:04,342::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270008 s, 37.9 MB/s\n'; <rc> = 0
>Thread-363::DEBUG::2014-01-24 19:45:04,676::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.34.63.199:_cmg01/464da998-ebd2-46a1-bab0-1c02a21a165e/dom_md/metadata bs=4096 count=1' (cwd None)
>Thread-363::DEBUG::2014-01-24 19:45:04,681::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n342 bytes (342 B) copied, 0.000345228 s, 991 kB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:05,309::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:05,314::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:45:06,351::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:06,401::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245832 s, 41.7 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:07,316::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:07,321::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:45:08,410::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:08,463::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275246 s, 37.2 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:09,324::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:09,330::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1124::INFO::2014-01-24 19:45:10,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-1124::INFO::2014-01-24 19:45:10,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'a250db32-9b39-4533-8bc6-926d4ae17535': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00064699', 'lastCheck': '7.4', 'valid': True}, '464da998-ebd2-46a1-bab0-1c02a21a165e': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000345228', 'lastCheck': '5.4', 'valid': True}}
>Dummy-233::DEBUG::2014-01-24 19:45:10,472::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:10,525::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270157 s, 37.9 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:11,333::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:11,338::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Dummy-233::DEBUG::2014-01-24 19:45:12,534::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/3ea3dad7-383a-417b-b9b7-63ce4660f638/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None)
>Dummy-233::DEBUG::2014-01-24 19:45:12,587::storage_mailbox::733::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274463 s, 37.3 MB/s\n'; <rc> = 0
>Thread-120::DEBUG::2014-01-24 19:45:12,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/a250db32-9b39-4533-8bc6-926d4ae17535/metadata bs=4096 count=1' (cwd None)
>Thread-120::DEBUG::2014-01-24 19:45:12,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646908 s, 6.3 MB/s\n'; <rc> = 0
>Thread-12::DEBUG::2014-01-24 19:45:13,341::utils::555::root::(execCmd) '/sbin/ip -d -o link' (cwd None)
>Thread-12::DEBUG::2014-01-24 19:45:13,346::utils::575::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-1127::DEBUG::2014-01-24 19:45:13,803::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1127::INFO::2014-01-24 19:45:13,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1127::INFO::2014-01-24 19:45:13,803::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}}
>Thread-1128::DEBUG::2014-01-24 19:45:13,820::BindingXMLRPC::159::vds::(wrapper) client [10.34.63.25]
>Thread-1128::INFO::2014-01-24 19:45:13,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='3ea3dad7-383a-417b-b9b7-63ce4660f638', options=None)
>Thread-1128::INFO::2014-01-24 19:45:13,821::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'spm_id': 1, 'master_uuid': 'a250db32-9b39-4533-8bc6-926d4ae17535', 'name': 'datacenter_iscsiTestStorage', 'version': '3', 'domains': u'a250db32-9b39-4533-8bc6-926d4ae17535:Active,464da998-ebd2-46a1-bab0-1c02a21a165e:Active', 'pool_status': 'connected', 'isoprefix': '', 'type': 'ISCSI', 'master_ver': 1, 'lver': 0}, 'dominfo': {u'a250db32-9b39-4533-8bc6-926d4ae17535': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '90865401856', 'version': 3}, u'464da998-ebd2-46a1-bab0-1c02a21a165e': {'status': u'Active', 'diskfree': '133606572032', 'isoprefix': '', 'alerts': [], 'disktotal': '144349954048', 'version': 0}}}

Actions: View

Attachments on bug 1057764: 855153 | 855154 | 857629 | 857630